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SETTING 


Th i s repor t exp Lores the int r t r t ^ 1 a1 one be twee n 

science and poi icy in a field that is the subject, of much 

debate—the assessment of the risk of cancer and other 
adverse health effects associated with exposure of humans 

to toxic substances. It is a report of a search for the 
institutional mechanisms that: best foster a constructive 
partnership between science and government , mechanisms to 
ensure that government regulation rests on the best avail¬ 
able .scientific knowledge and to preserve the integrity 
of scientific data and judgments in the unavoidable col¬ 
lision of the contending interests that accompany most 
impor ta n t r e g u 1 a t ory d ec is i ons . 

Many decisions of federal agencies in regulating 
chronic health hazards have been bitterly controversial. 
The roots of the controversy lie in improvements in 
scientific and technologic capability to detect poten¬ 
tially hazardous chemicals g in changes in public expec¬ 
tations and concerns about health protect ion , and in the 
fact that the costs and benefits of regulatory policies 
rail unequally on different groups within American 
soe iety - 

The decade of the 1970s was a period of heightened 
public concern about the effect?] of technology on the 
environment. Individuals and groups urged strict gov¬ 
ernment regulation as scientific evidence emerged that 
various chemical substances may induce cancers or other 
chronic health effects in humans * and new government 
programs were established to control potential hazards. 
The evidence of health effects of a few chemicals * such 
as asbestos , has been clear; in many more cases the 
evidence is meager and indirect. To aid decision-making. 
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In each step, a number; o 1 dec is ion [joints (company ry:: 

occur: w h e l • * r ill, to human health can on l / be m! i reoi 

from the a v a i Lab) e ev idence • Both sc lent i! Ic j udymen te 
and policy choicees may be involved in select i ng from 

among possible inferential bridges , and we have used the 
t e 1 m ri sjy _a sees s me rit _ p el icy t o d i f f e r e n t i a t e t hose ju d c 1 - 
merits and choices troru the broader social and economic 
policy issues that are Inherent in risk management deci¬ 
sions- At least some of the controversy surrounding 
regulatory actions has resulted from a blurring of the 
d is 1; inct ion be tw e en risk ass e ssme n t po 1 icy and r i sk 
ma n ag e me n t po 1 i c y. 
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agencies have ve x '--.o. ■ v- ic 

health hazards and »>- - ' - u 

posed by products arc >c: i - - - 

alleviating the corita • - - x ' 

s ions , the proc -ft ~ ^ - of 

criticism by scientists,, *- j t 

p ublic-interest g roups, 


STUDY Y 1 > ,__ 

The Committee on Inst u j' u a. w*i- "■ ' . i > *. „ ' *1 

Risks to Public Health was , . ' • a 

congressional directive* to ii;1 f i i.1 tk rr• a pr Jr ;i v 
objectives; 

• To assess the merits cl rcviva . : • i.ic i y - c 

functions of developing risk assessments looi the 
regulatory functions of making pelic y decisions, 

• To consider tne f p- u s L b ) 1 of designating e 
single organization to do risk assessments for all 
regulatory agencies, 

• To consider the feasibill ly nr Y : viloping uni fori 

risk assessment guidelines for use by all regulatory 
agencies. 

The Committee considered the * u r r tt . act ice of r i: ; 

assessment and its relation i ) < ' ( ui v la! k i 

of hazards to human health, past efforts to develop arm 

use risk assessment guidelines, the exper ience of gov¬ 
ernment regulatory agencies with different adirt inistrat ze 
arrangements for risk assessment , and various proposal: 
to modify risk assessment procedures. Out study was 
directed primarily, although not exoiusively f to the 
issue of increased ri. s k of c ancer resu.1ti ng f i o m expo s ie 
to chemicals in the environment,, an issue that has ai:o? sed 
great public concern in recent years, as illustrated h 
the controversies i nvolvin g the co n tro 1 o f sae c h ar 1 n, 
asbestos, and formaldehyde* Despite this emphasis, 
however, our conclusions and recommendations are appli 
cable in some degree across the broad field of environ 
mental health. 

Criticisms of risk assessment have ranged broadly f urn 
details of the process to administrative management to 

statutory authority. The mandate to this Committee di 

not include examination of the scientific issues invol Bd 
in risk assessment or the broad social policy question 


t 1 c a r fed*-?.. l Jr C j . ” L ' i ^ 1 r * i - u i \ a; r * - ' o^LCLsor: 

, J 3ii f V { d . ft ) ' |4 C<od a H ! _ 1 v m J i ~ _ L ’ , b lj.\ ! ,r- 4 pa— 

-lovJ r‘^Z r ~L/ orV 1 ' l C C~ /'-] k T .c ’ i ' Ai\) -c* < 

- >.’ ,, 13uv c; il u i_O 1 UC t b ”« 4 "7 v ~ ' j * i 's''? 1 r,er J r , </& 

piuik’ry cul ho; tt v c , < iu <P „ t i , m ‘ i - f ,= _ -1 - 1 joUrnoe., 

^'.'t UC c ‘ c rhl Oiilv [ r cl ’ t • ‘ £ i&icr O/Ri T 0' r s . f“ t. - r v j ek: i v 

L 1 U J iiC'Llblrr lia/e iu.jjj u klt-Jiy ( t ? >Rj ( >* o. *o .*:* /_- r . 

insf lC at Lon.fi l cnfti io. Tin Cumm t At c p . i ,r, : m c r> '»’tv >zi of 
A e ncj ‘’c.ucluirj < nrf [\ r^duf 0i< j ri s uU * nipt. ; , - 'Jr 
/; i le i a£ meiits of Los c itut ionoJ s.jkk.j. *o «rN i >- -> ■ - 

’zaf ion, Examples wore ./‘lectHi »- i i»i r t i jo- * l l ^ s t 

H 3 A re*- J o s sepoiortior aiul root toil ad ik^i ‘u Ok i >\ fi 
agenc \ es . independent ^cieut if ±<* itn'D-v jmih-j j d. ».. b^on 
io<'d to out -j in so if to oi the .id/drtaqt r ph ( dvr 

orgcinizat tonal separat ion r and some of their exper lences 

w e r e e xam in e cl« 

Cross-agency comparisons are difficult * because the 
regulatory agencies and their various programs differ 
markedly in structure , procedures , personnel character¬ 
istics , administrative history#- and statutory direction.. 

In addition, agencies and programs change , and practices 
adhered to for several, years may be altered substantially. 
These practical limitations to the evaluation of agency 
structures and practices led the Committee to conclude 
that predicting the likely effects of organizational 
rearrangements on agency performance of: risk assessment 
is unavoidably judgmental* However, the available 
evidence shows no clear advantage of one administrative 
structure over another * 

CONCLUSIONS AND MAJOR RECOMMENDATIONS 


Dissatisfaction with the actions of federal regulatory 
agencies is often expressed as criticism of the conduct 

and administration of the risk assessment process. The 




An inference guideline is an szpl:,aic statement of a pr e- 
determined choice among al < ~ - r < r i „ f rooce 

options ) that might be used to infer n.anan risk from data 
that are not fully adequate or are rot drawn Jrrectly fro 
human experience* For example,, a guideline raghc specify 
the mathematical model to be used co esciraace due effects 
of exposure at low doses r, - .-a ' * . _ : umc of 

exposure at high doses. 

Over the last 2 decades, l\o : fed::-an l v iL a.cry 
agencies and other institutions responsible Cor risk 
assessment of toxic chemicals nave song n t to develop such 
guidelines. Their efforts have met with marled success* 
Agencies have cited several reasons for writing guide¬ 
lines? to provide a systematic way to meet statutory 
requirements, to inform the public and regulated indus¬ 
tries of agency policies, to stimulate public comment on 
those policies, to avoid arguing generic ouestions anew 
in each specific case, and to foster consistency and 
continuity of approach* Interagency guidelines for 
carcinogens, although short-lived, were developed by the 
agencies of the Interagency Regulatory Liaison Group 
(IRLG) and adopted by the President 8 s Regulatory Council 
in 1979. The stated objective of that effort was to 
reduce inconsistency, duplication of effort, and lack of 
coordination among the federal agencies* 

The form of guidelines varies widely,. Some guidelines 
are comprehensive and detailed, addressing most of the 
components of risk assessment and describing underlying 
scientific concepts? others address only a few broad 
principles. Guidelines differ greatly in their degree of 
flexibility, i,e» f the degree to which they permit 
assessors to consider scientific evidence that may jus¬ 
tify departures from the prescribed inference options. 

And they vary in the legal authority vested in them: 
some are adopted as formal regulations and others by less 
formal means„ 

The Committee concludes that guidelines are feasible 
and, if properly designed, desirable; that clear state¬ 
ments of the inferences to be made in each step would be 
of advantage to the regulatory agencies, to the industries 
concerned, and to the general public; and that guidelines 
should be used uniformly by the governmental agencies. 




We agree with proponents of such measures as the 
v u o Oj , i .it ’-s' - t i . uOLh Cm tj I s proposed science 
panel and H a R a 638 that r-iioi ts should be made by regu¬ 
lators and others to distinguish clearly between the 
assessment of risk and the choice of regulatory options. 

We advocate the adoption of specific procedural mea¬ 
sures that can De introduced under current arrangements. 
These measures include timely independent scientific 
review of major agency risk assessments and, to facili¬ 
tate both scientific and public review of risk assess- 
inents, th€3 rout ime preparat ion of wr itten r isk assess~ 
ments that explicitly state the basis of choice among 
inference options. 

( R5 W e recommend that un iform___ infer ence _<2 uide~ 

lines be develop e d for t he us e of federal tegula - 

tory_jagencies in the ri sk a ss es sment p rocess_. 

The Committee endorses the development and use of 
guidelines for risk assessment. These guidelines, which 
would structure the interpretation of scientific and tech¬ 
nical i nformation relevant to the assessment of health 
risks* should be followed by all federal agencies,. They 
should address all elements of risk assessment, but allow 
flexibility to consider unique scientific evidence in 
pai t iciilar instances« 

T he u s e of u n if or m g u i d e 1 i n e s wo u Id p r onto t €3 c iai; i t y * 

completeness, and consistency in risk assessment; would 
clarify the relative roles of scientific and other factors 
in risk assessment policy; would help to ensure that 
assessments reflect the} latest scientific understanding; 
and would enable regulated parties to anticipate govern¬ 
ment decisions. In addition, adherence to inference 
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appropriate. 

We believe that risk a sees one „ 1 aa a* : o aov*- d mo > 
surely and more effectively by udoy z I no .5 ,• ao'. j r -mu -a oil 
three major parts: (A) iiTrghLeiuenL.it Lon <A yrroenlurci 
changes to ensure that individual jimM-ooiTi ^ j rmitinm f 
take full advantage of the cuciit.ioie no i.-o^ l J. iv know!.. Ige, 
while preserving the diversified approaches to lhr act n~ 
istration of risk assessment nertescaty t;r, mocoimnodate ;he 
varied needs of federal regulatory grog: rug (o) scan- 
dardization of analytic procedures aiuong f^derc»i peon 11ns 
through the development und use of uniform interonce 
guidelines; and (C) creation of a mechanism that will 
ensure orderly and continuing review and mod ification >f 




when this 1:3 deemed iK-c^ssary to prof oc L the nr-alta 
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of new fedeial teg ill story laws that ore applicable- to the 
environment, both in the v;ork|/iace and in the coinmurr) cy „ 
These lawn reflect a dramatic and relatively rapid shift 
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m science nave contributed to policy problems, tor the 
advances have revealed the extent ol the envi continental 
health problem* Sonic? earlier regulatory programs had 
addressed exposure to toxic chemicals, but they were 
d i rooted mainly at the risk of poisoning and other acute 
effects * Much policy-making related to such effects 
involved routine, short-term, acute animal studies to 
establish " no-observed-ef feet” doses and then the 
straightforward calculation of allowable human exposure 
based on the application of safety factors to relatively 
uncomplicated scientific findings. Such an approach 
reflected little recognition of problems that mignt be 
associated with smaller exposures* Cancer, birth defects, 
and other conditions were seldom seen as preventable? by 
government intervention. Only in the last 15 years has 
the potential extent of the linkage between such condi¬ 
tions and toxic substances been revealed. The often- 
cited estimate that a large fraction of all cancer s may 
be attributed to human exposure to toxic agents (including 
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fairly recently (Boyland, 1969; Higginson, 1969), and it 
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• A regulatory framework based on the traditional 
approach involving no~observed-effect doses and safety 

factors is now being applied to health effects for whi n 
a no-effect dose cannot be demonstrated, see < \)t <tt zei 
exposure. 

• Regulatory laws and programs designed for the 
elimination of what was understood to be the very rare 
event of chronic hazard now operate in the presence of 
the recognition that many agents are suspect. 

• Agencies must evaluate hundreds of chemicals on 
which no data related to human risk are available and n 






12 


know still less about chronic health effects other t an 
cancer. 

Ethical considerations prevent deliberate human < :peri- 
mentation with potentially dangerous chemicals, and .he 
length of the latent period for cancer and some oth< : 
effects greatly complicates epidemiologic studies oi 
uncontrolled human exposures. Animal models must b< used 
to investigate whether exposure to a chemical is re: ited 
to the incidence of health effects, and the results mst 
be extrapolated to humans. To 'make judgments amid t ich 
uncertainty, risk assessors must rely on a series o: 
assumptions. 


Limited Analytic Resources 

The number of chemicals in the jurisdiction of fed ral 
regulatory agencies is enormous. For example, of le 
roughly 5,000,000 known chemicals, more than 70,00 are 
in commercial use (Fishbein, 1980). The Environme tal 
Protection Agency's Chemical Activities Status Reg rt 
lists about 3,500 chemicals as being under some sc t of 
active consideration in the Agency's various regul tory 
programs. Similarly, the Food and Drug Administrc .ion's 
food program must cope with over 2,000 food-relate chemi¬ 
cals (900 flavors, 700 items listed as "generally ecog- 
nized as safe," 350 food additives, 175 animal dri s, and 
60 color additives) and an additional 12,000 indi] *ct 
additives (Flamm, 1981). 

The many problem chemicals in an agency's juris liction 
compete for attention of analysts and decision-mal irs. 

If an agency is considering new action on many sul stances 
at once, its scientific staff is stretched thin. lost 
agencies do not have the analytic resources to do i 
thorough risk assessment for priority-setting and mst 
rely on less formal methods to ensure that the hi< lest- 
risk chemicals are examined first. 


Complexity 

For most chemical agents that might be subject to regula¬ 
tion, a great variety of factors must be assessed includ¬ 
ing potential toxicity, extent of human exposure, effec¬ 
tiveness of technologies to reduce exposure, the ature 
of possible substitute chemicals, effects on and nterests 
of various population groups, and economic effect of 
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regulatory alternatives. Decision-makers in a regulatory 
agency may encounter a large amount of highly technical 
information as they work toward their decisions? many 
scientific disciplines and technical fields are usually 
involved. An agency would like to have simple rules and 
analytic procedures to ensure consistency and competence 
in its decision-making, but, in. the face of scientific 
uncertainty, such simplicity is difficult to achieve 
without an inadvertent loss of crucial scientific insight 
from the decision process. 


EXTERNAL PRESSURES 


Public Concern with Health Protection 

When the risk involves a serious disease, such as cancer, 
or birth defects, feelings are likely to run high, par¬ 
ticularly if the groups exposed to a chemical are mobil¬ 
ized to express themselves in an agency's deliberations. 
Such groups insist that regulatory action need not await 
conclusive evidence of cause and effect and need not be 
based exclusively on the most scientifically advanced 
testing methods. 


Visible Economic Interests 


Although it is rarely known which individuals are likely 
to be saved from adverse health effects through a regu¬ 
lation that reduces exposure to a particular chemical, 
those who bear the economic costs of such restrictions 
can identify themselves without any difficulty. These 
parties can provide relatively concrete projections of a 
prospective regulation's inflationary influence, effect 
on employment, and other immediate economic effects, and 
such consequences may be substantial. They may question 
the wisdom of balancing concrete evidence of economic 
damage against evidence of health protection that depends 
on a complex series of assumptions derived from sparse 
and indirect data. 


Congressional Action 

In fulfilling its role as the legislative voice of popular 
concerns. Congress can act in ways that influence decision 
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processes. It can dictate the factors to be included i 
and excluded from decision-making (the Delaney clause s 
an example), and it can pass special legislation to pr - 
empt agency discretion, as it did in acting to prevent 
the removal of saccharin from the market. 


PROPOSED REFORMS 


Under these conditions, it would perhaps be surprising if 
calls for major reform were not heard. Some have soug t 
to improve the techniques that the government uses to 
analyze and evaluate risks; for example, the House of 
Representatives in 1982 passed H.R. 6159 (commonly kn< m 
as the "Ritter bill"), to establish a government-wide 
program of research and demonstration projects on quai • 
titative and comparative risk analysis. 

Much of the recent controversy is general; it refl< ;ts 
the conflict in values between different groups in so< - 
ety, particularly with regard to the relative importa :e 
of economic factors and health protection in the formi .a- 
tion of regulatory decisions. Different groups will 
inevitably disagree about the degree of risk (if any) 
that is defined as acceptable in a particular case. 
However, some criticisms directly address the risk 
assessment component of the overall decision-making 
process. Some critics question whether current pract ms 
adequately safeguard the quality of the scientific 
interpretations needed for risk assessment. With a 
scientific base that is still evolving, with large 
uncertainties to be addressed in each decision, and w th 
the presence of great external pressures, some see a 
danger that the scientific interpretations in risk 
assessments will be distorted by policy consideratioi ;, 
and they seek new institutional safeguards against si h 
distortion. 

Among the institutional reforms suggested, two ma; >r 
categories are the focus of this reports reorganizai .on 
to ensure that risk assessments are protected from 
inappropriate policy influences and development and i se 
of uniform guidelines for carrying out risk assessme ts. 

Some argue that scientific quality, consistency, id 
distinction between scientific judgment and policy j clg- 
ment can be improved through the use of explicit gui e- 
lines for agency risk assessments. Such guidelines ould 
specify methods for interpreting scientific data and 
would seek to limit analysts who confront data gaps r 
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extrapolation questions to methods that are consistent 
with the best current scientific judgment. Analysts 
following the guidelines would find it easier to describe 
systematically and explicitly the methods that are incor¬ 
porated in their risk assessments. 

Several other recent proposals call for major restruc¬ 
turing of federal processes to separate the risk assess¬ 
ment function organizationally from decision-making. The 
objectives would be to permit analysts to work indepen¬ 
dently of policy pressures and to foster consistency of 
risk assessments. Various approaches have been suggested, 
including creation of a single body outside the government 
for the performance or review of risk assessments, crea¬ 
tion of a single government unit to conduct risk assess¬ 
ments for the entire government, and creation of separate 
risk assessment units in particular programs or agencies 
and systematic review of assessments by independent 
scientific advisory groups. 


THE STUDY 

This report responds to a congressional request to examine 
the merits of the two major types of reform proposal. It 
is the final report of the National Research Council's 
Committee on the Institutional Means for Assessment of 
Risks to Public Health. Chapter I describes the structure 
of risk assessment, the role of science in the assessment 
process, and current federal uses of risk assessment. 
Chapter II examines the feasibility and desirability of 
the development and use of uniform guidelines. Chapter 
III reviews various organizational arrangements for risk 
assessment. The Committee's overall conclusions and 
recommendations appear in Chapter IV. 
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I 

Hie Nature of 
RiskAssessment 


Recent criticisms of the conduct and use of risk assess¬ 
ment by regulatory agencies have led to a wide range of 
proposed remedies, including changes in regulatory stat¬ 
utes and the development of new methods for assessing 
risk. The mandate to this Committee was more limited. 

Our objective was to examine whether alterations in 
institutional arrangements or procedures , particularly 
the organizational separation of risk assessment from 
regulatory decision-making and the use of uniform guide¬ 
lines for inferring risk from available scientific infor¬ 
mation, can improve federal risk assessment activities. 

Before undertaking to determine whether organizational 
and procedural reforms could improve the performance and 
use of risk assessment in the federal government, the 
Committee examined the state of risk assessment and the 
regulatory environment in which it is performed. In this 
chapter, we define risk assessment and differentiate it 
from other elements in the regulatory process, analyze the 
types of judgments made in risk assessment, and examine 
its current government context. Because one chronic 
health hazard, cancer, was highlighted in the Committee's 
congressional mandate and has dominated public concern 
about public health risks in recent years, most of our 
report focuses on it. Furthermore, because activities in 
four agencies—the Environmental Protection Agency (EPA), 
the Food and Drug Administration (FDA), the Occupational 
Safety and Health Administration (OSHA), and the Consumer 
Product Safety Commission (CPSC)—have given rise to many 
of the proposals for changes in risk assessment practices, 
our review focuses on these four agencies. The conclu¬ 
sions of this report, although directed primarily at risk 
assessment of potential carcinogens as performed by these 
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four agencies, may be applicable to other federal pr< (rams 
to reduce health risks. 


TERMINOLOGY 


Despite the fact that risk assessment has become a s Dject 
that has been extensively discussed in recent years, 10 
standard definitions have evolved, and the same cone pts 
are encountered under different names. The Committe 
adopted the following terminology for use in this re ort. 


RISK ASSESSMENT AND RISK MANAGEMENT 


We use risk assessment to mean the characterization f 
the potential adverse health effects of human expost es 
to environmental hazards. Risk assessments include 
several elements: description of the potential adv< :se 
health effects based on an evaluation of results of 
epidemiologic, clinical, toxicologic, and environme :al 
research; extrapolation from those results to predi< : the 
type and estimate the extent of health effects in h nans 
under given conditions of exposure; judgments as to :he 
number and characteristics of persons exposed at va ious 
intensities and durations; and summary judgments on the 
existence and overall magnitude of the public-healt 
problem. Risk assessment also includes characteriz tion 
of the uncertainties inherent in the process of inf rring 
risk. 

The term risk assessment is often given narrowei and 
broader meanings than we have adopted here. For sc e 
observers, the term is synonymous with quantitativ< risk 
assessment and emphasizes reliance on numerical res Its . 
Our broader definition includes quantification, bu also 
includes qualitative expressions of risk. Quantity :ive 
estimates of risk are not always feasible, and the; may 
be eschewed by agencies for policy reasons. Broad* : uses 
of the term than ours also embrace analysis of per ved 
risks, comparisons of risks associated with differ it 
regulatory strategies, and occasionally analysis o the 
economic and social implications of regulatory dec 3ions~ 
functions that we assign to risk management. 

The Committee uses the term risk management to escrifc 
the process of evaluating alternative regulatory a tions 
and selecting among them. Risk management, which s car¬ 
ried out by regulatory agencies under various legj lativ< 
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mandates, is an agency decision-making process that 
entails consideration of political, social, economic, and 
engineering information with risk-related information to 
develop, analyze, and compare regulatory options and to 
select the appropriate regulatory response to a potential 
chronic health hazard. The selection process necessarily 
requires the use of value judgments on such issues as the 
acceptability of risk and the reasonableness of the costs 
of control. 


STEPS IN RISK ASSESSMENT 


Risk assessment can be divided into four major steps: 
hazard identification, dose-response assessment, exposure 
assessment, and risk characterization, A risk assessment 
might stop with the first step, hazard identification, if 
no adverse effect is found or if an agency elects to take 
regulatory action without further analysis, for reasons 
of policy or statutory mandate. 

Of the four steps, hazard identification is the most 
easily recognized in the actions of regulatory agencies. 

It is defined here as the process of determining whether 
exposure to an agent can cause an increase in the inci¬ 
dence of a health condition (cancer, birth defect, etc.). 
It involves characterizing the nature and strength of the 
evidence of causation. Although the question of whether 
a substance causes cancer or other adverse health effects 
is theoretically a yes-no question, there are few chemi¬ 
cals on which the human data are definitive. Therefore, 
the question is often restated in terms of effects in 
laboratory animals or other test systems, e.g., "Does the 
agent induce cancer in test animals?" Positive answers 
to such questions are typically taken as evidence that an 
agent may pose a cancer risk for any exposed humans. 
Information from short-term in vitro tests and on struc¬ 
tural similarity to known chemical hazards may also be 
considered. 

Dose-response assessment is the process of character¬ 
izing the relation between the dose of an agent adminis¬ 
tered or received and the incidence of an adverse health 
effect in exposed populations and estimating the incidence 
of the effect as a function of human exposure to the 
agent. It takes account of intensity of exposure, age 
pattern of exposure, and possibly other variables that 
might affect response, such as sex, lifestyle, and other 
modifying factors. A dose-response assessment usually 
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requires extrapolation from high to low dose anc extrapo¬ 
lation from animals to humans. A dose-response ssess- 
ment should describe and justify the methods of .extrapola¬ 
tion used to predict incidence and should charac erize 
the statistical and biologic uncertainties in tl sse 
methods. 

Exposure assessment is the process of measur. lg or 
estimating the intensity, frequency, and duratic i of 
human exposures to an agent currently present ii the 
environment or of estimating hypothetical exposi res that 
might arise from the release of new chemicals i :o the 
environment. In its most complete form, it des< ribes the 
magnitude, duration, schedule, and route of exp sure; the 
size, nature, and classes of the human populate is 
exposed? and the uncertainties in all estimates Exposure 
assessment is often used to identify feasible p Dspective 
control options and to predict the effects of a ailable 
control technologies on exposure. 

Risk characterization is the process of esti ating the 
incidence of a health effect under the various end itions 
of human exposure described in exposure assessn nt. It 
is performed by combining the exposure and dose response 
assessments. The summary effects of the uncert .inties in 
the preceding steps are described in this step. 

The relations among the four steps of risk i sessment 
and between risk assessment and risk management are 
depicted in Figure 1-1. The type of research : iformation 
needed for each step is also illustrated. 


SCIENTIFIC BASIS FOR RISK ASSESSMENT 


Step 1. Hazard Identification 

Although risk assessment as it is currently pr, sticed by 
federal agencies for the estimation of carcincx mic risk 
contains several relatively new features, the zsientific 
basis for much of the analysis done in risk as sssment is 
well established. This is especially true of ne first 
step in the assessment process, hazard identif :ation. 
Four general classes of information may be use in this 
step: epidemiologic data, animal-bioassay dat , data on 
in vitro effects, and comparisons of molecular structure. 

Epidemiologic Data 

Well-conducted epidemiologic studies that s ow a posi¬ 
tive association between an agent and a diseas are 




different conditions?) 
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accepted as the most convincing evidence about hu an risk. 
This evidence is, however, difficult to accumulat ? often 
the risk is low, the number of persons exposed is small, 
the latent period between exposure and disease is long, 
and exposures are mixed and multiple. Thus, epic miologic 
data require careful interpretation. Even if the e prob¬ 
lems are solved satisfactorily, the preponderance of 
chemicals in the environment has not been studiec with 
epidemiologic methods, and we would not wish to 1 lease 
newly produced substances only to discover years ater 
that they were powerful carcinogenic agents. Th< ie 
limitations require reliance on less direct evidc ce that 
a health hazard exists. 

Animal-Bioassay Data 

The most commonly available data in hazard id ltifica- 
tion are those obtained from animal bioassays. ' ie infer¬ 
ence that results from animal experiments are ap Licable 
to humans is fundamental to toxicologic research this 
premise underlies much of experimental biology a 3 medi¬ 
cine and is logically extended to the experiment L obser¬ 
vation of carcinogenic effects. Despite the app cent 
validity of such inferences and their acceptabil :y by 
most cancer researchers, there are no doubt occa ions in 
which observations in animals may be of highly u certain 
relevance to humans. 

Consistently positive results in the two sexe and in 
several strains and species and higher incidence at 
higher doses constitute the best evidence of cai inoge- 
nicity. More often than not, however, such date are not 
available. Instead, because of the nature of tl effect 
and the limits of detection of animal tests as \ ey are 
usually conducted, experimental data leading to i posi¬ 
tive finding sometimes barely exceed a statistic 1 thresh¬ 
old and may involve tumor types of uncertain re it ion to 
human carcinogenesis. Interpretation of some ai .mal data 
may therefore be difficult. Notwithstanding un srtaintie 
associated with interpretation of some animal t< its, they 
have, in general, proved to be reliable indicat rs of cat* 
cinogenic properties and will continue to play pivotal 
role in efforts to identify carcinogens. 

Short-Term Studies 

Considerable experimental evidence supports he propo¬ 
sition that most chemical carcinogens are mutag as and 
that many mutagens are carcinogens. As a resul , a 
positive response in a mutagenicity assay is su portive 
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/idence that the agent tested is likely to be carcino- 
enic. Such data, in the absence of a positive animal 
ioassay, are rarely, if ever, sufficient to support a 
onclusion that an agent is carcinogenic. Because short- 
arm tests are rapid and inexpensive, they are valuable 
or screening chemicals for potential carcinogenicity and 
anding additional support to observations from animal 
nd epidemiologic investigations. 

Comparisons of Molecular Structure 

Comparison of an agent’s chemical or physical proper- 
ies with those of known carcinogens provides some evi- 
ence of potential careinogenicity• Experimental data 
upport such associations for a few structural classes; 
Dwever, such studies are best used to identify potential 
arcinogens for further investigation and may be useful 
n priority-setting for carcinogenicity testing. 


tep 2. Dose-Response Assessment 

n a small number of instances, epidemiologic data permit 
dose-response relation to be developed directly from 
bservations of exposure and health effects in humans• 
f epidemiologic data are available, extrapolations from 
he exposures observed in the study to lower exposures 
xperienced by the general population are often necessary. 
uch extrapolations introduce uncertainty into the esti- 
ates of risk for the general population. Uncertainties 
Iso arise because the general population includes some 
eople, such as children, who may be more susceptible 
han people in the sample from which the epidemiologic 
ata were developed. 

The absence of useful human data is common for most 
hemicals being assessed for carcinogenic effect, and 
ose-response assessment usually entails evaluating tests 
hat were performed on rats or mice. The tests, however, 
ypically have been designed for hazard identification, 
ther than for determining dose-response relations, 
nder current testing practice, one group of animals is 
iven the highest dose that can be tolerated, a second 
roup is exposed at half that dose, and a control group 
s not exposed. (The use of high doses is necessary to 
aximize the sensitivity of the study for determining 
hether the agent being tested has carcinogenic poten- 
ial.) A finding in such studies that increased exposure 
eads to an increased incidence has been used primarily 
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to corroborate hazard identification, that is, :o show 
that the agent does indeed induce the adverse . salth 
effect. 

The testing of chemicals at high doses has 1 sen 
challenged by some scientists who argue that me abolism 
of chemicals differs at high and low doses; i.< , high 
doses may overwhelm normal detoxification mechc isms and 
provide results that would not occur at the lo\ r doses 
to which humans are exposed. An additional fac or that 
is often raised to challenge the validity of ar mal data 
to indicate effects in man is that metabolic di ferences 
among animal species should be considered when nimal 
test results are analyzed. Metabolic differenc s can 
have important effects on the validity of extra olating 
from animals to man if, for example, the actual carcino¬ 
gen is a metabolite of the administered chemica and the 
animals tested differ markedly from humans in t sir pro¬ 
duction of that metabolite. A related point is :hat the 
actual dose of carcinogen reaching the affected -.issue or 
organ is usually not known; thus, dose-response Informa¬ 
tion, of necessity, is based on administered doi * and not 
tissue dose. Although data of these types wouL certainly 
improve the basis for extrapolating from high tc low doses 
and from one species to another, they are diffi< lit to 
acquire and often unavailable. 

Regulators are interested in doses to which 1 .mans 
might be exposed, and such doses usually are muc lower 
than those administered in animal studies. Thei fore, 
dose-response assessment often requires extrapol ting an 
expected response curve over a wide range of dos s from 
one or two actual data points. In addition, dif erences 
in size and metabolic rates between man and labc atory 
animals require that doses used experimentally b con¬ 
verted to reflect these differences. 

Low-Dose Extrapolation 

One may extrapolate to low doses by fitting a nathemat- 
ical model to animal dose-response data and usin' the 
model to predict risks at lower doses correspond ig to 
those experienced by humans• At present, the tri t shape 
of the dose-response curve at doses several orde 5 of 
magnitude below the observation range cannot be < ter- 
mined experimentally• Even the largest study on ecord— 
the EDqjl study involving 24,000 animals—was des] ned 
only to measure the dose corresponding to a 1% ii rease 
in tumor incidence. However, regulatory agencies are 
often concerned about much lower risks (1 in 100, 00 to 1 
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in 1,000). Several methods have been developed to extrap¬ 
olate from high doses to low doses that would correspond 
to risk of such magnitudes. A difficulty with low-dose 
xtrapolation is that a number of the extrapolation 
methods fit the data from animal experiments reasonably 
well, and it is impossible to distinguish their validity 
on the basis of goodness of fit. (From a mathematical 
point of view, distinguishing among these models on the 
basis of their fit with experimental data would require 
n extremely large experiment; from a practical point of 
view, it is probably impossible)• As Figure 1-2 shows, 
the dose-response curves derived with different models to 
iverge below the experimental doses and may diverge subs¬ 
tantially in the dose range of interest to regulators. 
Thus, low-dose extrapolation must be more than a curve¬ 
fitting exercise, and considerations of biological plau¬ 
sibility must be taken into account. 

Although the five models shown in Figure 1-2 may fit 
experimental data equally well, they are not equally 
plausible biologically. Most persons in the field would 
agree that the supralinear model can be disregarded, 
ecause it is very difficult to conceive of a biologic 
mechanism that would give rise to this type of low-dose 
response. The threshold model is based on the assumption 
that, below a particular dose (the "threshold" dose of a 
given carcinogen) there is no adverse effect. This con¬ 
cept is plausible, but not now confirmable. The EDq^ 
tudy showed an apparent threshold for bladder cancers 
caused by 2-acetylaminofluorene; when the data were 
eplotted on a scale giving greater resolution (OTA, 

1981), the number of bladder tumors consistently in¬ 
creased with dose, even at the lowest doses, and no 
threshold was detected. Another aspect of the debate 
over thresholds for inducing carcinogenic effects is the 
argument that agents that act through genotoxic mecha¬ 
nisms are not likely to have a threshold, whereas agents 
whose effects are mediated by epigenetic mechanisms are 
possibly more likely to have a threshold. The latter 
argument is also currently open to scientific challenge. 
Finally, apparent thresholds observable in animal bio¬ 
assays cannot be equated with thresholds for entire 
populations. Even if a threshold exists for individuals, 
a single threshold would probably not be applicable to 
the whole population. 

Animal-to-Human Dose Extrapolation 

In extrapolating from animals to humans, the doses 
used in bioassays must be adjusted to allow for differ- 



rently are used for this adjustment and assume that animal 
and human riots are cqui valent, v/hen desses are measured as 
urn f s * . , m per day, as milligrams per square 
meter of oody su:race area, as parrs per million ii', air* 
cl ie c s or V' a 1 aror as mi r 1 ig cares per a r — 09r am per r ills-" 
time. Although seme me roods for con/ersion are used more 
froquenoiv r ho n otrers.. a scientific oasis few: choosing 
one over the other is not established* 


S t sp 3. Exposu re Ass e ssmen t 


the first task of an exposure assessment is the determina¬ 
tion. of the concentration of the chemical to which humans 
are exposed. This may be known from direct measurements 
but more typically exposure data are incomplete and must 
be estimated- Models for estimating exposure] can be com¬ 
plex* even in the case of structured activity/ as occurs 
in the workplace. Exposure measurements made on a small 
g 1:o 11 p (e.g. * workers in a particti 1 ar 1 nbt 11 s ir 1 a 1 f irn 1} are 
often applied to other segments of the worker population* 
Exposure assessment in an occupational setting consists 
primarily of estimation of long-term airborne exposures in 
fne workplace„ However , because an agent may be present 
at various concentrations in diverse occupational set¬ 
tings* a census of exposures Is difficult said costly to 
conduct. In the community environments- the ambient con¬ 
centrations of chemicals to which people may be exposed 
can be estimated front emission rates only if the transport 
and conversion processes aie known* Alternative engineer- 
ing control options require different estimates of the 
reduction in exposure that may be achieved* For new chem¬ 
icals with no measurement data at all* rough estimations 
of exposure are necessary* Some cheroi ea L agents are of 
concern because they are present in foods or: may be ab¬ 
sorbed when a consumer product is used. Assessments of 
exposure to such agents are complicated by variations in 
diet and personal habits among different groups in the 
population. Even when the amount of an agent in a food 
can be measured 4 d <.f ferences in food storage practices* 
food preparation* and dietary frequency often lead to a 
wide variation in the amount of the agent that individuals 
ingest. Patterns of use affect exposure to many consumer 
products; for example* a solvent whose vapor is poten¬ 
tially toxic may be used outdoors or it may be used in a 
small* poorly ventilated room* where the concentrat ion of 
vapor in the air is much higher* 



EXTRA RISK P(d) - P(tA 



DOSE (/Jtj/weok; 

FIGURE 1-2 Results of alternative extrapolation rnoc Is 
for the same experimental data® NOTE: Bose-resport ■ 
functions were developed (Crump* in press) for data rom 
a benzopyrene carcinogenesis experiment with mice 
conducted by Lee and 0 8 Neill ( 1971 ) . 
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\'l'c depends as a xu/noer of l > 1 c/p 

i extent .of available data. 


Hazard I d entification 

E pj.de hi i o 1 ag i c D a t a 

® What relative weights should be given to studies 
with differing results? For example, should positive 
results outweigh negative results if the studies that 
yield them are comparable? Should a study be weighted in 
accord with its statistical power? 

° What relative weights should be given to results 
of different types of epidemiolci i. c studies? For example 
should the findings of a prospective study supersede thos 
of a case-control study ? or those of a case-control study 
those of an ecologic study? 

• What statistical significance should be required 
for results to be considered positive? 

Does a study have special characteristics (such 
as the questionable appropriateness of the control group) 
that lead one to question the validity of its results? 

• What is the significance of a positive finding in 
a study in which the route of exposure is different from 
that of a population at potential risk? 

• Should evidence on different types of responses 
be weighted or combined (e.g. „ data on different tumor 
sites and data on benign versus malignant tumors)? 


An imal-B ioas sa y Da ta 

• What degree of confirmation of positive results 
should be necessary? Is a positive insult from a single 
animal study sufficient, or should positive results from 
two or more animal studies be required? Should negative 
results be disregarded or given less weight? 

• Should a study be weighted according to its 
quality and .statistical power? 

° How should evidence of different metabolic 
pathways or vastly different metabolic rates between 
animals and Inmans be factored into a risk assessment? 

• How should the occurrence of rare tumors be 
treated? Should the appearance of rare tumors in a 
treated group be considered evidence of carcinogenicity 
even if the finding is not statistically significant? 
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care ifiooeniciry? li~ determi rieiticr 
judgment or the q uaIle v of tne data ore 
p r e c e d i eg s ac t i. c r: s„ # 
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Dose-R esp onse A sse s seen t 

Epidemiologic Data 

• What dose-response models should be used to 
extrapolate from observed doses to relevant doses? 

8 Should dose-response relations oe extrapolated 
according to best estimates or according to upper confi¬ 
dence limits? 

• How should risk estimates be adjusted to account 
for a comparatively short follow-up period in an epide¬ 
miologic study? 

• For what range of health effects should responses 
be tabulated? For example, should risk estimates be made 
only for specific types of cancer that are unequivocally 
related to exposure# or should they apply to all types of 

cancers? 

• How should exposures to other carcinogens, such 
as cigarette smoke# be taken into consideration? 

• How should one deal with different temper til expo¬ 
sure patterns in the study population and in the popula¬ 
tion for which risk estimates are required? For example, 
should one assume that lifetime risk is only a function 
of total dose, irrespective of whether the dose was 
received in early childhood or in old age? Should recent 
doses be weighted less than earlier doses? 

• How should physiologic characteristics be factored 
into the dose-response relation? For example, is there 
something about the study group that distinguishes its 
response from that of the general population? 

Animal-BioasBay Data 

• What mathematical models should be used to extrap- 
olate from experimental doses to human exposures? 

• Should dose-response relations be extrapolated 
according to best estimates or according to upper con¬ 
fidence limits? If the Latter, what confidence limits 
should be used? 

• What factor should be used for interspecies con¬ 
version of dose from animals to humans? 





u Mow ShGLU „ > “ « C { 

the exposure roui t < * 

are different? 

“ Should a dose-: a "i - . . - - .- --<* 

counted when the tumors if. qcav 11 o... .rev? h..oi nr ,-xtre sly 
variable spontanecus r ate s? 

* What statistical -v 

for results to te considered pocit it o' 

* Does an expe indent nave special chaacte is tin s 

{®* g* # the presence of careinocewic ccncacicantc in tr 
test substance) toat lead one co quest inn rhe vaiiaity d£ 
its results? 

• How should findings r , •* u •= ' \ag e ... 

toxic effects be used m thn . wtr;:- nr.. :n. o^t/nor 
data? Should evidence that tumoru mov bay-: diced t om 

these effects be tacen to mean tn.o enty \/ouo: v>c be 
expected to occur at .mv/et dcses - 

* Should benign and iial lunarlet ions bn- count 2d 
equally? 

* Into what categories should tumors be grouped £< 
statistical purposes? 

• Should only increases in the {lumbers of tumors 1 ! 
considered, or should a decrease in the latent period :or 
tumor occurrence also be used as evidence of 
carcinogenicity? 

Short-Term Test Data 

• How much weight should be placed on the results 
of various short-term tests? 

• What degree of confidence do short-term tests a 3 
to the results of animal bioassays in the evaluation f 
carcinogenic risks for humans? 

• Should in vitro transformation tests oe accorde 
more weight than bacterial mutagenicity tests in seek ng 
evidence of a possible carcinogenic ef f.ect? 

• What statistical significance should be requirt? 
for results to be considered positive? 

* How should different results of comparable test 

be weighted? Should positive results be accorded gr f fen 
weight than negative results? 

Structural Similarity to Known Carcinogens 

* What additional weight does structural similar y 
add to the results of animal bioassays in the eyal.ua- on 

of carcinogenic risks for humans? 
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THE ^INTERPLAY OF_SCIENCE AMD POLICY I N R ISK ASSESSMENT 

t ion o!i risk as we ssiw.-int is that removal cf risk assessment 
from Lhe regulatory agomiec will result In a clear deiuar- 
c a t i o n o f c 1 1 e & c i o ■ j e e a a d po j. i c v a s p e c i:s of r e g u 1 a t o r y 
elec Is ion-rnak ing . Ho we vc r , peal icy consider a tions inev i.~* 
t ab 1 y a f f ec t fl , a 1 iJ p t r 1 j a i * s ci e t ene l h e s oute of t h e cho i ces 
among the inK-runue options,, To examine the tyoes of 
judgments required In risk asswesmeni r the Committee has 
a nelly zed severe I components and the in* e tense optionee Cor 
e ac h. 


H a z a i: d I d e n t i f: i c a 11 o n 


This Committee lias identified 25 components in hazard 
identification* These components differ in a number of 
ways. However , two major d if: fcrences germane to the 
question considered here are the degree of scientific; 
uncertainty encountered in each and the effect of 
choosing different inference options on the outcome of 
the risk assessment. Consider the following examples. 

One component of risk assessment is the decision as to 
whether to use experimental animal data to infer risks to 
humans. Although data from studies of rats and mice may 
not: always be predictive of adverse health effects in 
humans^ the scientific validity of this approach is widely 
accepted. The use of positive animal data is the more 
conservative choice for this component. The use of 
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Cthe/i j Lhojoan.'S in cose- re specs e assessment chat will 
affect cue tleai ar1 i no.; c 1 to i.ucie choie*° of cine exper: i- 
o e n t a i ■ la fa - ^ ^ cuing cany 1.h a t might be uraiiaoie) 

to be need to Ooilculot.- the rel.il t c n bo been dose and 
^ k j i * ar « . ! l u ' ? , a rat of trie most sensitive 

a a i r i a i g rot p w L J J r t„* s a 1 .1 l r t tn e t a a s t c *:? n s t r v a t i. v e e s t i - - 
in a re) , rtoio;: of a ne a l bvg fat lo: for cocao rs: on of doses 
in anlmais to o. urn a n s {the r ir>is c ole elated can vac y bn a 
fee tot ot up to i 5depend iag on t: h a method used), and 
the dee is non ol' whether to combine tin not types in deter¬ 
mining .incidence (as mentioned earlier, the decision to 
lump tumors might be more or less conservative than the 
decision not to combine incidences from <1 l Cl^ttnc. tumor 
types) . 


Ex pos- i t ( 1 - 


(discussion of specific components in exposure assessment 
is complicated by the fact that current methods and 
approaches to exposure assessment appear to be mediarm- or 
route-specific. In contrast with hazard identification 
and dose-response asse ssrnent , exposure assessment has very 
few components that could be applicable to all media* 

For example, a model describing transport of a chemical 
th t o u g h the atmos p1 1 e r e i s ne ce s sa ri 1y quite d 1 ££ e ren t 
from a model describing transport. through water or soil, 
whereas the use of a particular dose-response extrapola¬ 
tion model in dose-response assessment is Independent of 
the medium or route of exposure. In any event, an 
assessor has several options available for estimating 
exposure to a particular agent in a particular med 1 urn, 
and these options will yield more or less conservative 
estimates of exposure. Among the options are different 
assumptions about the frequency and duration of human 
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exposure to an agent or medium, rates of intaki or con¬ 
tact, and rates of absorption. 

Risk Characterization 

The final expressions of risk derived in this * :ep will 
be used by the regulatory decision-maker when 1: alth risk* 
are weighed against other societal costs and b< lefits to 
determine an appropriate action. Little guidar e is 
available on how to express uncertainties in tt under¬ 
lying data and on which dose-response assessmer s and 
exposure assessments should be combined to give a final 
estimate of possible risk. 


Basis for Selecting Inference Options 

The Committee has presented some of the more fa iliar, 
and possibly more controversial, components of Lsk 
assessment. A review of the list of components reveals 
that many components lack definitive scientific answers, 
that the degree of scientific consensus concern mg the 
best answer varies (some are more controversial among 
scientists than others) , and that the inference options 
available for each component differ in their de< :ee of 
conservatism. The choices encountered in risk ssessment 
rest, to various degrees, on a mixture of scieni .fic fact 
and consensus, on informed scientific judgment, and on 
policy determinations (the appropriate degree oi 
conservatism). 

That a scientist makes the choices does not ] jnder the 
judgments devoid of policy implications. Scient sts dif¬ 
fer in their opinions of the validity of various options, 
even if they are not consciously choosing to be ore or 
less conservative. In considering whether to us data 
from the most sensitive experimental animals for risk 
assessment, a scientist may be influenced by the species, 
strains, and gender of the animals tested, the c arac- 
teristics of the tumor, and the conditions of tfc experi¬ 
ment. A scientist's weighting of these variable may not 
easily be expressed explicitly, and the result i a mix¬ 
ture of fact, experience (often called intuition , and 
personal values that cannot be disentangled easi y. As a 
result, the choice made may be perceived by the sientist 
as based primarily on informed scientific judgme t. From 
a regulatory official's point of view, the same < loice 
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ay appear to be a value decision as to how conservative 
egulatory policy should be, given the lack of a decisive 
[tipirical basis for choice. 

A risk assessor, in the absence of a clear indication 
ased on science, could choose a particular approach 
e.g., the use of an extrapolation model) solely on the 
asis of the degree to which it is conservative, i.e., on 
he basis of its policy implications. Furthermore, a 
esire to err on the side of overprotection of public 
ealth by increasing the estimate of risk could lead an 
ssessor to choose the most conservative assumptions 
hroughout the process for components on which science 
es not indicate a preferred choice. Such judgments 
ade in risk assessment are designated risk assessment 
olicy, that is, policy related to and subservient to the 
cientific content of the process, in contrast with policy 
voked to guide risk management decisions, which has 
olitical, social, and economic determinants. 

When inference options are chosen primarily on the 
asis of policy, risk management considerations (the 
sire to regulate or not to regulate) may influence the 
hoices made by the assessors. The influence can be 
eneric or ad hoc; i.e., assessments for all chemicals 
ould consistently use the more or less conservative 
nference options, depending on the overall policy orient¬ 
ation of the agency ("generic"), or assessments would 
ary from chemical to chemical, with more conservative 
ptions being chosen for substances that the agency wishes 
o regulate and less conservative options being chosen for 
ubstances that the agency does not wish to regulate. 

The desire to regulate or not would presumably stem from 
ubstance-specific economic and social considerations.) 
he possible influence of risk management considerations, 
whether real or perceived, on the policy choices made in 
isk assessment has led to reform proposals (reviewed 
.ater in this report) that would separate risk assessment 
ctivities from the regulatory agencies. 

Table 1-1 recapitulates the terms introduced in this 
iscussion. 


RISK ASSESSMENT IN PRACTICE 


'his section addresses past agency practices of risk 
Lssessment associated with efforts to regulate toxic 
substances. 
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TABLE 1-1 Summary of Terms 


Risk Assessment , Risk assessment is the qua 
or quantitative characterization of the potenti 
effects of particular substances on individuals 
populations. 

Risk Management . Risk management is the prc 
evaluating alternative regulatory options and s 
among them. A risk assessment may be one of tfc 
risk management. 

Steps . Risk assessments comprise many or a] 
following steps: hazard identification, dose-r 
assessment, exposure assessment, and risk 
characterization. 

Components . Steps in risk assessment comprj 
components—points in a risk assessment at whic 
ments must be made regarding the analytic appr< 
taken. 

Inference options . For many components, tw< 
inference options are available. 

Risk Assessment Policy . Risk assessment po 
consists of the analytic choices that must be i 
course of a risk assessment. Such choices are 
both scientific and policy considerations. 


RISK ASSESSMENT AND REGULATORY DECISION-MAKING 

The regulatory process can be initiated in mar 
Each regulatory agency typically has jurisdict 
large number of substances, but circumstances 
allocation of resources to a few at a time. T 
as to which substances to regulate is based, a 
part, on the degree of hazard. Thus, some not 
tive hazard (implicit or explicit, internally 
or imposed by outside groups) is necessary. C 
federal regulation have contended that the age 
not set their priorities sensibly. In genera] 
risk assessments for priority-setting have bee 
informal, less systematic, and less visible tl 
for establishing regulatory controls. 
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Agenda-setting involves decisions about which sub- 
tances should be selected (and often in what order) for 
ore intense formal regulatory review. All programs face 
his problem, but it assumes different configurationss 
ome programs cover a finite and known set of chemicals 
hat must be reviewed, so the order of the regulatory 
eviews is the key question, and the primary job of the 
isk assessor is to help the agency implement a worst- 
irst approach. For example, EPA’s pesticides program 
as long had lists of suspect pesticide ingredients, and 
gency officials have had to decide which ones warrant 
ormal consideration of cancellation or of new controls, 
n agency’s agenda may also respond to private-sector 
nitiatives (in the case of approval of new drugs or 
esticides), conform to statutory directives, or react to 
iew evidence of hazards previously unrecognized or thought 
o be less serious. This agenda formation phase, too, 
nvolves elements of risk assessment by the agency, the 
ongress, or private-sector entities? that is, there must 
•e some assessment, however informal, that indicates 
eason for concern. 

For many items on an agency’s regulatory agenda, 
azard identification alone will support a conclusion 
hat a chemical presents little or no risk to human 
ealth and should be removed from regulatory considera- 
ion, at least until new data warrant renewed concern, 
f a chemical is found to be potentially dangerous in the 
azard-identification step, it could then be taken through 
he steps of dose-response assessment, exposure assess- 
lent, and risk characterization. At any of these steps, 
he evaluation might indicate that a substance poses 
.ittle or no risk and therefore can be removed from 
egulatory consideration until new data indicate a need 
or reevaluation. 

Chemicals that are judged to present appreciable risks 
.o health are candidates for regulatory action, and an 
igency will begin to develop options for regulating expo- 
iures. Regulatory options usually involve specific 
>roduct or process changes and typically need to be based 
>n extensive engineering and technical knowledge of the 
iffected industry. Evaluation of the regulatory options 
.ncludes recomputation of the predicted risk, in accord 
rith altered expectations of exposure intensity or num- 
>ers of persons exposed. 

Many of the activities of regulatory agencies do not 
jonform to this sequential approach. However, regardless 
>f the sequence of steps and the number of steps used to 
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determine whether regulatory action is warrante , ri 
assessment serves at least two major functions n re 
tory decisions: . first, it provides an initial sses 
of risks, and, if the risk is judged to be impc tant 
enough to warrant regulatory action, it is used :o e 
ate the effects of different regulatory options Dn e 
sure. In addition, it may be used to set prior lies 
regulatory consideration and for further toxici f te 
These varied functions place different requi ‘men 
risk assessors, and a single risk assessment m :hoc 
not be sufficient. A risk assessment to establ ;h t 
priorities may appropriately incorporate many w :st- 
assumptions if there are data gaps, because rest rch 
should be directed at substances with the most < uci 
gaps; but such assumptions may be inappropriate or 
analyzing regulatory controls, particularly if e r 
lator must ensure that controls do not place unc e s 
on the economy. In establishing regulatory pri< itj 
the same inference options should be chosen for 11 
cals, because the main point of the analysis is on 
useful risk comparisons so that agency resources ril 
used rationally. However, this approach, which ay 
reasonable for priority-setting, may have to yic 3 t 
more sophisticated and detailed scientific argun tits 
a substance’s commercial life is at stake and th ag 
decision may be challenged in court. Furthermoi , \ 
available resources and the resulting analytic c :e 
devoted to a risk assessment for deciding regula or] 
policy are likely to be much greater for analyzi j 
control actions for a single substance than for >ti 
priorities. 


THE AGENCIES THAT REGULATE 

The approach to risk assessment varies considera .y 
the four federal agencies. Differences stem prii r 
from variations in agency structure and differen ts 
statutory mandates and their interpretation. 


Organizational Arrangements 

The Food and Drug Administration (FDA) is a comp< e 
the Department of Health and Human Services, whoi 
Secretary is the formal statutory delegate of th< g 
exercised by FDA. FDA is headed by a single offi i 
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i Commissioner of Food and Drugs, who is appointed by 
i serves at the pleasure of the Secretary of the Depart- 
lt of Health and Human Services. It is organized in 
Dduct-related bureaus, each of which employs its own 
.entists, technicians, compliance officers, and adminis- 
ators. FDA has a long (75-year) and strong scientific 
id ition. According to a recent Office of Technology 
sessment summary, FDA had taken or proposed action on 
potential carcinogens by 1981. 

Like FDA, the Environmental Protection Agency (EPA) is 
ided by a single official, but EPA's Administrator is 
pointed by the President subject to Senate confirmation, 
so like FDA, EPA resembles a confederation of relatively 
screte programs that are coordinated and overseen by a 
itral management. The agency was established in 1970, 
t many of its programs (e.g., air and water pollution 
itrol and pesticide regulation) predate its formation 
d previously were housed in and administered by other 
?artments. Other programs, such as those for toxic 
bstances and hazardous waste, are rather new. EPA's 
search, policy evaluation, and, until recently, enforce- 
nt efforts were separated organizationally from the 
gram offices that write regulations. EPA has had the 
dest experience with regulating carcinogens; as of 
31, it had acted on 56 chemicals in its clean-water 
ogram, 29 in its clean-air program, 18 in its pesticide 
Dgram, and two in its drinking-water program. 

The Occupational Safety and Health Administration 
3HA) is part of the Department of Labor. The agency's 
ad is an Assistant Secretary of Labor, who requires 
nate confirmation. Although FDA and EPA derive their 
ientific support largely from their own full-time 
ployees, until the late 1970s OSHA relied on other 
ncies, primarily the National Institute of Occupa- 
:>nal Safety and Health, an agency of the Department of 
alth and Human Services. This division reflects a 
nscious congressional choice in 1970 to place the 
alth experts on whom OSHA was expected to rely in an 
tside environment believed more congenial to scientific 
quiry and less vulnerable to political influence. As 
1981, 18 potential carcinogens had been acted on by 
HA. 

The Consumer Product Safety Commission (CPSC) enforces 
/e statutes, including the Consumer Product Safety Act 
d the Federal Hazardous Substances Act. Both empower 
3C to regulate unreasonable risks of injury from prod- 
s used by consumers in the home, in schools, or in 
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recreation. The much smaller CP SC differs sharp r from 
the other three agencies in two important re spec 3 ; it 
does not have a single administrative head, but istead 
is governed by five Commissioners, who can make ajor 
regulatory decisions only by majority vote? and ie 
Commissioners are appointed for fixed terms by t e 
President with Senate confirmation. Before 1981 CPSC 
had acted on five potential carcinogens. 

The four agencies have attempted to coordinat risk 
assessment activities in the past, most notably hrough 
the Interagency Regulatory Liaison Group (IKLG), which 
formed a work group on risk assessment to develc a guid 
line for assessing carcinogenic risks. Assisted by scie 
tists from the National Cancer Institute and th< Nati'ona 
Institute for Environmental Health Sciences, it xamined 
the various approaches used by the four agencie, to eval 
ate evidence of carcinogenicity and to assess r: k. The 
IRLG (1979a,b) then integrated and incorporated :hese 
evaluative procedures into a document, "Scienti: ,c Bases 
for Identification of Potential Carcinogens and Jstima- 
tion of Risks," which described the basis for e iluatior 
of carcinogenic hazards identified through epid niologi< 
and experimental studies and the methods used f : quant! 
tative estimation of carcinogenic risk. 


Regulatory Statutes* 

Examination of the statutes that the four agenc es adnti 
ister reveals important differences in the star ards fch 
govern their decisions. The Office of Technolc y Asses 
ment has summarized (Table 1-2) statutes that 1 rtain t 
the regulation of carcinogenic chemicals. In ] rticula 
the statutes accord different weights to such c iterta 
risk, costs of control, and technical feasibil :y. In 
addition, different modes of regulation vary ii their 
capacity to generate the scientific data neces iry to 
perform comprehensive risk assessments. 

Several laws require agencies to balance re ilatory 
costs and benefits. Examples of balancing pro .sions 1 
found in the Safe Drinking Water Act? the Pede ii Insei 
cide, Fungicide, and Rodenticide Act? the Toxi Substai 


*This discussion draws heavily on the Office c Tech¬ 
nology Assessment report. Technologies for Pet rmininq 
Cancer Risks from the Environment, 1981. 
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Control Act; and the section on fuel additives in the 
Clean Air Act. Under such provisions, a risk assessment 
can be used to express the nature and extent of public- 
health benefits to be attained through regulation. 

Some regulatory programs involve the establishment of 
technology-based exposure controls. This approach is 
followed, for example, in portions of the clean-water 
program and the part of the hazardous-wastes program that 
deals with waste-incineration standards. In such pro¬ 
grams, a risk assessment may be used to show the human 
exposure that corresponds to a specific degree of risk or 
to calculate the risk remaining after control technologies 
are put in place. 

Some statutes mandate control techniques to reduce 
risks to zero whenever hazard is affirmed. Such tech¬ 
niques include outright bans of products, as envisioned 
in the Delaney clause in the Federal Food, Drug, and 
Cosmetic Act. In addition, if the concept of a threshold 
below which carcinogens pose no risk is not accepted, 
strict interpretations of ample margin of safety language 
in federal clean-air and clean-water legislation would 
require that exposures to carcinogenic pollutants be 
reduced to zero. The role of risk assessment in cases 
where mandatory control techniques must reduce risks to 
zero may be simply to affirm that a hazard exists. 

The difference between programs that involve premarket¬ 
ing approval of substances and programs that operate 
through post hoc mechanisms , such as environmental emis- 
- sion limits, may have an important influence over the 
i quality of risk assessments. The most important effect 

3 of this difference may lie in the fact that premarketing 

3 approval programs (such as those for pesticides, for new 
i human drugs, and for new food additives) empower an agency 

a to require the submission of sufficient data for a compre¬ 

hensive risk assessment, whereas other programs tend to 
leave agencies to fend for themselves in the acquisition 
of necessary data. 

There can be little question that differing statutory 
standards for decision affect the weight that agencies 
r accord risk assessments. Like differences in the mode of 

t regulation, they probably have affected the rigor and 

c scope of many assessments. If risk is but one of several 

criteria that a regulator must consider or if data are 
expensive to obtain, it would not be surprising if an 
agency devoted less effort to risk assessment. However, 
the Committee has not discovered differences in existing 
statutes that should impede the adoption of uniform. 
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government-wide risk assessment guidelines. Indee 
is not satisfied that there are legal bases for in 
agency differences in the performance—as distinct 
the use—of risk assessment for chronic health haz 


CONCLUSIONS 

On the basis of a review of the nature and the pol 
context of risk assessment, the Committee has draw 
following general conclusions: 

1. Risk assessment i s only one aspect of the p 
of regulatory control of hazardous substances. Th 
improvements in risk assessment methods cannot be 
to eliminate controversy over federal risk manageir 
decisions. 

Restrictive regulation has seemed onerous to ma 
turers, distributors, and users of products judged 
and valuable? conversely, inaction and delay with 
to regulatory proceedings have appeared callous an 
irresponsible to others. These dissatisfactions Y 
been manifested in many ways, including criticism 
assessment processes. The Committee believes that 
of this criticism is inappropriately directed and 
rise to an unrealistic expectation that modifying 
assessment procedures will result in regulatory de 
more acceptable to the critics. Certainly risk as 
can and should be improved, with salutary effects 
appropriateness of regulatory decisions. However, 
management, although it uses risk assessment, is c 
by political, social, and economic forces, and rec 
decisions will continue to arouse controversy and 
conflict. 

2. Risk assessment is an analytic process tha^ 
firmly based on scientific considerations, but it 
requires judgments to be made when the available 
tion is incomplete. These judgments inevitably d] 
both scientific and policy considerations. 

The primary problem with risk assessment is th; 
information on which decisions must be based is u 
inadequate. Because the decisions cannot wait, tl 
in information must be bridged by inference and b 
and these cannot be evaluated in the same way as 
Improving the quality and comprehensiveness of kn 
is by far the most effective way to improve risk 
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merit, but some limitations are inherent and unresolvable, 
and inferences will always be required. Although we 
conclude that the mixing of science and policy in risk 
assessment cannot be eliminated, we believe that most of 
the intrusions of policy can be identified and that a 
major contribution to the integrity of the risk assess¬ 
ment process would be the development of a procedure to 
ensure that the judgments made in risk assessments, and 
the underlying rationale for such judgments, are made 
explicit. 

3. Two kinds of policy can potentially affect risk 
assessment: that which is inherent in the assessment 
process itself and that which governs the selection of 
regulatory options. The latter, risk management policy, 
should not be allowed to control the former, risk 
assessment policy. 

Risk management policy, by its very nature, must entail 
value judgments related to public perceptions of risk and 
to information on risks, benefits, and costs of control 
strategies for each substance considered for regulation. 
Such information varies from substance to substance, so 
the judgments made in risk management must be case- 
specific. If such case-specific considerations as a 
substance's economic importance, which are appropriate to 
risk management, influence the judgments made in the risk 
assessment process, the integrity of the risk assessment 
process will be seriously undermined. Even the perception 
that risk management considerations are influencing the 
conduct of risk assessment in an important way will cause 
the assessment and regulatory decisions based on them to 
lack credibility. 

4. Risk assessment suffers from the current absence 
of a mechanism for addressing generic issues in isolation 
from specific risk management decisions . 

Although the practice of risk assessment has progressed 
in recent years, there is currently no mechanism for stim¬ 
ulating and monitoring advances on generic questions in 
relevant scientific fields or for the timely dissemina¬ 
tion of such information to risk assessors. 
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II 

Inference Guidelines 
for RiskAssessment 


INTRODUCTION AND DEFINITIONS 


An inference guideline * is an explicit statement of a 
predetermined choice among the options that arise in 
inferring human risk from data that are not fully ade¬ 
quate or not drawn directly from human experience. A 
guideline might, for example, specify the mathematical 
model to be used to estimate the effects of exposure at 
low doses from observations based on higher doses. The 
most important feature of guideline use is that it change s 
the risk assessment process from one in which inference 
options are selected on a substance-by-substance basis to 
one in which they are selected once and thereafter 


*The Committee hopes to avoid any misunderstanding result¬ 
ing from its use of the terms inference guideline and 
guideline (used for brevity in lieu of inference guide ¬ 
line) . This terminology is potentially confusing, because 
guidelines can be understood as codified principles ad¬ 
dressed to a particular subject matter, risk assessment, 
or as describing the legal weight of any codified stan¬ 
dards or principles. For the Committee, it has the former 
meaning. Inference guidelines are the principles followed 
by risk assessors in interpreting and reaching judgments 
based on scientific data. (Thus, our inference guide¬ 
lines are distinct from the standards for toxicologic and 
other testing standards that many regulatory agencies and 
scientific bodies have adopted to govern, or at least 
influence, the generation of data later used in risk 
assessment.) 

For many lawyers, the term guideline connotes the 
weight to be given to any set of codified principles, not 
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applied to an entire series of chemicals. In the abs nee 
of guidelines, assessors may well select the same inf r- 
ence options for substance after substance in a giver 
agency program, and a common set of inference options may 
emerge, in common law fashion, from their consistent 
application in the program. But even the continued i e 
of the same set of inference options over time does r t 
necessarily imply that the assessors would make the s me 
choices for every substance. Furthermore, outsiders 
would have no way of knowing what the common set is. in 
contrast, the use of guidelines makes more evident tfc 
generic choice of inference options, which we have sc n 
in Chapter I, is based on both scientific and risk 
assessment policy considerations. 


HISTORY OF THE USE OF GUIDELINES 

SAFETY EVALUATION GUIDELINES FOR EFFECTS OTHER THAN C SCEl 

The development and use of guidelines by a regulatory 
agency first became of major importance after Congres 


only those addressed to risk assessment, in legal pre 
ceedings. The Food and Drug Administration, for exan le, 
has defined a guideline as an official pronouncement f 
the agency describing a procedure that satisfies lege 
requirements, but is not mandated by law. A more con let 
treatment of the distinction between binding regulati ns 
and other formal agency pronouncements appears in the 
section of this chapter entitled "Degree to Which Gu: e~ 
lines May Be Binding on an Agency and a Regulated Par 
The Committee has used the term guideline to desci be 
the principles by which risk assessments are to be pc - 
formed, because that is the term Congress used in the 
legislation that authorized this study. The Committc 
was asked to consider the feasibility of establishing 
uniform "risk assessment guidelines." There is no e\ - 
dence that Congress was aware of the different meanii s 
of the term. It obviously was seeking advice about \ e 
intellectual and scientific bases for codified princ; les 
for risk assessment, not the appropriate legal form i r 
their adoption. Faced with possible confusion no mai er 
which terminology it chose, the Committee has retain* 
the language that Congress itself used to describe oi 
inquiry. 
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enacted amendments to the Federal Food, Drug, and Cos¬ 
metics Act in the 1950s and early 1960s. These laws, as 
applied to noncarcinogenic agents, required that food 
additives, color additives, drugs for animals, and pesti¬ 
cides be shown to be safe under their intended conditions 
of use before premarket approval by the Food and Drug 
Administration (FDA). The agency developed guidelines to 
provide a systematic way to deal with the legal require¬ 
ments embodied in the amendments. Although guidelines 
for the conduct of various types of toxicity tests 
received greatest notice, some attention was given to the 
problem of data interpretation for inferring human risk. 
For example, a 1959 publication written by several members 
of the FDA Division of Pharmacology, Appraisal of the 
Safety of Chemicals in Foods, Drugs, and Cosmetics , is 
devoted primarily to toxicity testing methods, but con¬ 
tains one chapter called "Some Interpretative Problems in 
Evaluating the Safety of Food Additives" (Lehman jet al., 
1959)• Although that publication, which served as a 
guide for both FDA and the regulated industry for at 
least a decade, was never published as a regulation, it 
was widely accepted by affected industrial concerns. 

In all cases except that of carcinogens, establishment 
of acceptable intakes was accomplished by applying safety 
factors to experimentally derived no-observed-effect 
exposures. Testing involved mostly the use of acute and 
subchronic (90-day) animal tests, although some long-term 
tests were required. The use of safety factors to estab¬ 
lish acceptable intakes was also recommended by the Food 
Protection Committee of the National Research Council 
(NRC/NAS, 1970) and adopted by the Joint Food and Agri¬ 
cultural Organization and World Health Organization 
Expert Committees on Food Additives (1972) and Pesticide 
Residues (1965)• This approach continues to be used for 
noncarcinogenic food additives and pesticides and, in 
slightly modified form, to define acceptable exposures to 
occupational and various environmental pollutants. 

These methods of assigning acceptable limits of expo¬ 
sure imply that the application of safety factors of 
various magnitudes to experimentally derived no-observed- 
effect exposures will ensure low risk. The acceptable 
exposure, whether expressed as an acceptable daily intake 
for a food additive or as a permissible exposure limit 
for an occupational agent, is derived by imposing untested 
assumptions (e.g., about the likely nature of dose- 
response relations at low doses) and by drawing inferences 
from sparse data. Safety evaluation schemes may therefore 
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be classified as a set of guidelines that emphasize test 
ing methods heavily and that afford methods of inference 
only scant attention. 

Recent efforts have dealt more directly with developi 
guidelines for risk assessment of noncarcinogenic effect 
The Environmental Protection Agency (EPA) has proposed 
guidelines for chemical mutagenesis (EPA, 1980a) and has 
collected public comments on them, but has yet to publis 
a final rule. In addition, the agency cosponsored two 
conferences with Oak Ridge National Laboratory on risk 
assessment methods for reproductive and teratogenic 
effects? the proceedings of the conferences have been 
published (ORNL/EPA, 1982) . The Interagency Regulatory 
Liaison Group began to develop guidelines for risk 
assessment of reproductive and teratogenic effects, but 
the effort ceased with the disbanding of the group in 
1981. The March of Dimes Birth Defects Foundation (1981 
has published the proceedings of a conference dealing 
with guidelines for studies of human populations exposed 
to mutagenic and reproductive hazards. Despite the 
increasing interest in noncarc inogenic effects, methods 
of estimating the risk of these effects have not been th 
subject of major public and scientific debate? attention 
has been devoted mainly to carcinogenic risk assessment* 
Much more critical review of the inferential methods for 
assigning risks to noncarc inogenic agents is warranted* 

guidelines for carcinogenic risk 

Until the late 1950s, few agents, either chemical or 
physical, had been regulated in this country on the basi 
of their carcinogenic action. One important regulated 
agent was ionizing radiation. Permissible exposures to 
radiation were set in a manner similar to that for none a] 
cinogenic agents, by application of safety factors appli* 
to specified exposures. In the debate over health effect 
of radioactive fallout from atomic weapons tests in the 
1950s, evidence to support a nonthreshold theory for 
cancer induction emerged. Evidence was also accumulated 

o indicate that the nonthreshold theory might be appli- 
c e to chemical carcinogens. It was in this context 
that Congress enacted statutes* in the 1950s and early 


The enactment of these statutes did not necessarily 
09 a unique new concept to FDA. m the early 1950s, 
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1960s that required FDA to ban the use of food and color 
additives shown to be carcinogenic. The assumption, 
which differed from that underlying safety evaluation of 
noncarcinogens, was that no exposure could be presumed 
safe. Thus, a full risk assessment scheme was not needed 
for carcinogens. The process stopped at hazard 
identification. 

Many factors contributed to the later use of ‘dose- 
response assessment, exposure assessment, and risk char¬ 
acterization to determine quantitative estimates of risk. 
One of these may have been the growing perception during 
the 1960s and 1970s that many kinds of risk could not be 
eliminated completely without unacceptable social and 
economic consequences. New laws reflecting this belief 
were enacted, and some agencies were required to balance 
the risk posed by carcinogenic agents against their per¬ 
ceived benefits. Quantitative risk assessment was the 
system developed to estimate the risk side of the bal¬ 
ance. Over a period of 2 decades, various expert com¬ 
mittees sponsored by government agencies and other 
organizations published numerous reports dealing with 
carcinogenicity evaluation. Most of these were state- 
of-the art reports on aspects of carcinogenicity infer¬ 
ence, and many suggested guidelines for hazard identifica¬ 
tion. More recent reports have dealt explicitly with 
quantitative risk assessment. The impetus for producing 
these reports was probably a belief in the federal re¬ 
search and regulatory communities that some scientific 
principles related to carcinogenicity data evaluation had 
to be continually reexamined and reaffirmed. This belief 
pervaded the public-health establishment not only in the 
United States, but also in other countries and in the 
United Nations. 

The following discussion examines efforts to develop 
and apply guidelines for the evaluation of carcinoge¬ 
nicity data by the federal regulatory agencies and the 
International Agency for Research on Cancer over the last 
decade—efforts that developed out of 2 decades of 
scientific consensus-building. 


before their enactment, the agency had prohibited three 
food additives on the grounds that they were found to be 
carcinogenic in test animals. 




56 


International Agency for Research on Cancer (IARC) 

In 1971, the International Agency for Research on Cancer 
(IAKC), an agency of the World Health Organization, began 
publication of a series of monographs on known and sus¬ 
pected carcinogens. These monographs are prepared by 
international groups of experts assembled by IARC, who 
critically review pertinent literature and draw conclu¬ 
sions regarding the carcinogenicity of various substances. 
The results of IARC reviews and evaluations are widely 
accepted. The guidelines used for evaluation by the IARC 
expert committees are set forth in the monographs. They 
are expressed in very general terms and are related to 
only six components of hazard identification, completely 
covered in six pages of text. A major feature of the 
guidelines is the presentation of criteria that classify 
the evidence of suspected carcinogens as sufficient or 
limited. The IARC allows the expert committees consid¬ 
erable latitude to evaluate many inference options on a 
case-by-case basis, although the agency appears to insist 
on adherence to the few stated guidelines. 


Food and Drug Administration 

The 1958 Food Additives Amendment to the Food, Drug, and 
Cosmetics Act prohibited the use of food additives found 
to be carcinogenic. The law was also interpreted as 
prohibiting FDA approval of any drug, for use in animals 

.lad been shown to cause 

•nal amendment, FDA was 
: a carcinogenic animal 
jd that no residue of a 
tissues of the treated 
lat FDA was to prescribe 
ying the absence of 
■tive proved to be unworkable, for 
r w 3 *v.ss in analytic chemistry was so rapid 
~ed methods of analysis quickly became obsolete 
d detection methods showed that no drug admini- 
animals is ever entirely absent from animal 
tissues. The problem of enforcing the 1962 amendment was 
highlighted in the early 1970s, when diethylstilbestrol 
residues were discovered in beef liver with highly sen¬ 
sitive, but as yet unapproved, analytic methods. 

In an attempt to provide a consistent and predictable 
procedure for approving methods to search for drug resi- 
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dues, FDA proposed sensitivity-of-method guidelines in 
the form of regulations (FDA, 1973, 1977, 1979b)• Rather 
than gear criteria to an analytic technique, the agency 
defined its standards in terms of risk. It proposed that 
any assay approved for controlling a carcinogenic drug 
must be capable of measuring residues that present more 
than an insignificant risk of cancer, and specified a 
1CT 6 lifetime risk of cancer as a quantitative criter¬ 
ion of insignificance. If a drug sponsor could provide a 
detection method capable of measuring residues posing a 
risk of this magnitude or greater, FDA would ignore resi¬ 
dues that could not be detected with this method. Thus, 
FDA found guidelines for quantitative estimation of risk 
necessary. FDA's sensitivity-of-method guidelines are 
unique in several ways. They address a narrow though 
complex set of issues encountered in regulating a single 
class of products, animal drugs. Although they deal to a 
large extent with testing, they were the first to address 
quantitative risk assessment methods, listing assumptions 
for dose-response assessment, exposure assessment, and 
risk characterization. And they are the only guidelines 
that attempt to establish a definition of significant 
risk . The guidelines have yet to be adopted, a decade 
after they were first proposed, but the agency has applied 
the methods of quantitative risk assessment embodied in 
the sensitivity-of-method document in connection with the 
regulation not only of animal drugs, but also of food 
contaminants, such as aflatoxin (FDA, 1979a) and trace 
constituents of some additives (FDA, 1982b). The 
sensitivity-of-method guidelines were proposed as regu¬ 
lations, as were the cancer guidelines of the Occupational 
Safety and Health Administration (OSHA). In both cases, 
regulation engendered substantial controversy. The major 
debate over the sensitivity-of-method guidelines has dealt 
not so much with risk assessment or the definition of 
significant risk as with the amount and cost of testing 
that FDA would require from industry before product 
approval. 


Environmental Protection Agency 

During the early to middle 1970s, EPA initiated actions 
to prohibit or restrict the use of several pesticides. 
The agency lacked internal procedures for assessing 
carcinogenic risk and relied heavily on the judgment of 
scientists outside EPA. Attorneys for EPA, in summar- 
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izing the testimony of their expert witnesses during 
administrative hearings on actions against the pesti¬ 
cides r set forth several statements that, in the legal 
brief, were referred to as cancer principles (EPA, 1972, 

1975) • They conveyed the idea that the only acceptable 
degree of regulation would be a total ban on exposures. 

The principles, perceived as EPA's cancer policy, incurred 
wide criticism from the scientific community, the private 
sector, and Congress. The impracticabi 1 ity of achieving 
zero risk on a broad scale for a large number of economi¬ 
cally important chemicals became increasingly apparent. 

In response to this new perception, and perhaps out of a 
desire to avoid misunderstanding of its cancer policy, 
the EPA became the first agency to adopt formal guidelines 
embracing a two-step process of risk assessment (EPA, 

1976) . The first step is a determination of whether a 
particular substance constitutes a cancer risk (hazard 
identification). The second step is a determination of 
what regulatory action, if any, should be taken to reduce 
the risk. As part of the second step, the agency explic¬ 
itly endorses the use of quantitative risk assessment as 
the means of determining the magnitude of the likely 
impact of a potential human carcinogen on public health. 
These guidelines were not published as regulations and 
enjoy fairly wide acceptance from most interested par¬ 
ties. As stated in the preface to the guidelines, they 
were published to improve agency procedures, to provide 
public notice of the approach that EPA would take, and to 
stimulate commentary from all sources on that approach. 

The guidelines were probably more important as a state¬ 
ment of a novel approach to risk assessment than for their 
content. They are quite general, cover less than a page 
of Federal Register text, and address only a few compo¬ 
nents of hazard identification, dose-response assessment, 
exposure assessment, and risk characterization. More 
detailed guidelines that specify assumptions for the 
choice of extrapolation models, scaling factors, and 
other elements of dose-response assessment were published 
in 1980 by program offices in EPA (EPA, 1980b) • These 
rely in part on the Interagency Regulatory Liaison Group 
(IRLG) guidelines (IRLG, 1979a) and are currently 
undergoing review. 


Occupational Safety and Health Administration 

In 1977, OSHA published guidelines in a proposed regula¬ 
tion, "Identification, Classification, and Regulation of 
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Toxic Substances Posing a Potential Occupational Risk of 
Cancer” (OSHA, 1977); after extensive administrative 
hearings, it published a final rule in 1980 (OSHA, 1980) . 
The guidelines proved to be highly controversial, and the 
hearings were marked by vigorous debate on almost every 
component of risk assessment covered by the guidelines. 
The OSHA rule, written by agency staff, was a detailed 
scientific and regulatory document that took several hun¬ 
dred pages of Federal Register text and addressed almost 
every component of hazard identification. The final rule 
did not address exposure assessment and rejected the use 
of dose-response assessment for any regulatory purpose 
except priority-setting. The main purposes of the guide¬ 
lines, as stated in the preface, were to streamline the 
process of risk assessment, to speed up regulation, and 
to reduce the workload of agency staff. Another purpose 
was to foster continuity of approach, even in the face of 
changes of policy-makers. OSHA staff perceived that the 
case-by-case approach to risk assessment was long and 
time-consuming, because the same controversial questions 
had to be argued each time a chemical was under consid¬ 
eration for regulation. The agency believed that the 
generic approach to risk assessment would reduce debate 
on these questions; the controversial issues could be 
decided once, incorporated into guidelines, and applied 
to all chemicals. For reasons of efficiency, the guide¬ 
lines were written in language that permitted little 
deviation from the judgments embodied in them. Because 
they were written as regulations, regulated parties were 
required to abide by them. The agency has not used the 
rule as a basis for any published scientific assessment 
of carcinogenic hazard. It was revised in 1981 (OSHA, 
1981) to accommodate the Supreme Court's ruling on ben¬ 
zene, which required that OSHA make a finding that the 
risk to workers in the absence of regulation was signifi¬ 
cant and would be reduced by the proposed standard. But 
this change and additional amendments were recently with¬ 
drawn, and the entire policy is under reconsideration 
(OSHA, 1982). 


Consumer Product Safety Commission 

The Consumer Product Safety Commission (CPSC) proposed 
cancer guidelines dealing mainly with hazard identifica¬ 
tion (CPSC, 1978) • Ten components related to that step 
were addressed in several pages of Federal Register text. 
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Some minor attention was given to exposure assessment and 
dose-response assessment, for priority-setting purposes 
only. The rationale for publishing the guidelines, as 
stated in the preface of that document, was to establish 
CPSC's general principles and to solicit comments on them, 
to assist the general public and the regulated industries 
in understanding standards that CPSC would apply and reg¬ 
ulatory actions that it was likely to take, and to set 
forth its approach to some issues that tended to recur in 
each case. The guidelines had no regulatory status; they 
were a statement of selected inference options to which 
the agency would adhere. The CP SC guidelines were never 
used; they were challenged in court, and the court ruled 
that CPSC had promulgated them illegally inasmuch as they 
were adopted without an opportunity for public comment. 
Furthermore, at that time CPSC had decided to rely on the 
guidelines of IRLG. 


Interagency Regulatory Liaison Group 

The four agencies represented in IRLG undertook the task 
of developing guidelines to "ensure that the regulatory 
agencies evaluate carcinogenic risk consistently." In 
1979, after an 18-month interagency effort, IRLG pub¬ 
lished a report, "Scientific Bases for Identification of 
Potential Carcinogens and Estimation of Risk." The repoi 
was prepared by personnel of CPSC, EPA, FDA, and OSHA, 
with the assistance of senior scientists from the Nation* 
Cancer Institute and the National Institute of Environ¬ 
mental Health Sciences. It was published in a scientific 
journal (IRLG, 1979b) and in the Federal Register (IRLG, 
1979a); IRLG requested public comment in the Federal 
Register . The IRLG report was said to represent an inte 
agency consensus on the scientific aspects of carcinogen 
risk assessment.* It was the most comprehensive set of 
guidelines that had been developed for agency use, add re 
sing most components of hazard identification and dose- 
response assessment with some general discussion of 


*Because rule-making was under way in connection with it 
cancer policy, OSHA declined to participate in the IRLG 
notice and comment procedure. After the report was 
completed, the Food Safety Quality Service of the U.S. 
Department of Agriculture joined IRLG and participated j 
the notice and comment. 
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exposure assessment and risk characterization? it had, 
however, no official legal status. The report was note¬ 
worthy, in that it constituted the first evidence that 
all the federal regulatory agencies agreed on the infer¬ 
ence options applicable to the identification of carcin¬ 
ogenic hazards and measurement of risks. The document 
made clear, however, that not all the agencies were bound 
to conduct quantitative assessments? it stated only that, 
if such assessments were to be conducted, they would be 
conducted uniformly. This language was probably a con¬ 
cession to OSHA's view, as expressed in its cancer policy, 
that quantitative risk assessment was to play no more 
than a priority-setting role in that agency's regulatory 
activities. Almost immediately after its publication, 
the IRLG report was adopted by the President's Regulatory 
Council and incorporated as the scientific basis of the 
Council's government-wide statement on regulation of 
chemical carcinogens. The Council viewed the IRLG guide¬ 
lines as a major step in reducing inconsistency, dupli¬ 
cation of effort, and lack of coordination among agencies 
in carcinogenic risk assessment (Regulatory Council, 

1979) . 

The scientific aspects of the final OSHA cancer policy, 
which was written to allow less latitude in the choice of 
inference options, were, nevertheless, in general agree¬ 
ment with the IRLG guidelines. CP SC and EPA stated that 
they relied on the IRLG document, but the degree to which 
they rely on it today is not clear. FDA has made no 
statement other than that associated with the document's 
initial publication? in fact, in a recent proposal con¬ 
cerning the application of risk assessment to a class of 
trace constituents of additives, FDA did not even cite 
the IRLG document as a reference (FDA, 1982b). Although 
IRLG received a great deal of public comment on the guide¬ 
lines, no report of the agencies' review of these comments 
has appeared. In fact, the document was heavily criti¬ 
cized by industry, because it was published in its final 
form and adopted before the comments could be analyzed 
and revisions incorporated. The Reagan Administration 
has officially disbanded the entire IRLG effort, so it is 
unlikely that review of the public comments will ever 
occur. 

Although the IRLG charter was not renewed, a similar 
group has been established, but one that is coordinated 
by the White House Office of Science and Technology 
Policy. This group has prepared a draft document on the 
scientific basis of risk assessment and has distributed 
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it for comment (OSTP, 1982) • The group anticipates that 
this document may serve as a reference point for later 
development of general guidelines for the agencies. 


VARIATION IN THE FORM OF GUIDELINES 
COMPREHENSIVENESS 

Guidelines developed by agencies in the past have varied 
in the extent to which they have addressed each of the 
steps of risk assessment. IARC 1 s guidelines address only 
hazard identification; OSHA 9 s guidelines (1980) dealt 
mainly with hazard identification, with some discussion 
of dose-response assessment and none of exposure assess¬ 
ment and risk characterization; and IRLG 1 s guidelines 
focused in detail on hazard identification and dose- 
response assessment, with some discussion of exposure 
assessment and risk characterization. 

Guidelines also have varied in the extent to which 
they have addressed the components of the risk assessment 
steps. IARC 1 s guidelines address a small number of 
components. Study of the latest IARC monograph (1982) 
reveals only six selected options that deal with inference 
of risks treatment of benign versus malignant tumors, the 
choice of statistical methods for application of data from 
animal studies, the relevance of negative results of epi¬ 
demiologic studies, the evaluation of tumors that occur 
spontaneously, the utility of short-term tests, and the 
overall weighting of evidence. The OSHA (1980) and IRLG 
documents, in contrast, each discussed and embraced over 
20 selected options dealing with hazard identification. 


EXTENT OF DETAIL 

Guidelines have differed not only in their comprehensive¬ 
ness, but also in the detail with which they have treated 
specific components of risk assessment. When the content 
of a guideline is detailed, the assessor is presented with 
more complete information than would be available from a 
more general guideline. For example, the statement in 
IARC 1 s guidelines on benign tumors is general, compared 
with that in the IRLG guidelines. IARC concludes briefly: 

If a substance is found to induce only benign 

tumours in experimental animals, it should be 
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suspected of being a carcinogen and requires 

further investigation. 

The IRLG document made a similar statement/ but in 
addition elaborated on several issues relevant to the 
evaluation of benign tumors that are not mentioned by 
IARC—e.g./ evaluation of tumor incidence when both benign 
and malignant tumors are present? a listing of tumor types 
commonly observed as benign in test animals, but known to 
progress to frank malignant stages; evaluation of the 
quality of a histologic examination that might be pre¬ 
sented as evidence? and an illustrative example of the 
dependence of response on the genetic characteristics of 
the test animal. The additional material could have been 
used by an assessor, particularly one not familiar with 
the newest information on benign tumors, to ensure that a 
more thorough analysis of the relevant issues had been 
performed. 


FLEXIBILITY 

Detail can often be confused with inflexibility, and it 
is important to make a distinction between these charac¬ 
teristics. Certainly, detailed guidelines can be inflex¬ 
ible if the detail is designed to limit agency discretion, 
and thus public debate, on an issue that is subject to 
multiple scientific interpretations. However, detailed 
guidelines can have quite a different effect if their 
intent is to provide an assessor with background informa¬ 
tion that describes the complexity of an issue, with 
nuances that may influence particular judgments, or with 
examples of cases that are legitimate exceptions to the 
general rule. 

As described in Chapter I, almost all components of 
risk assessment theoretically embrace one or more infer¬ 
ence options. For example, in determining which dose- 
response curve to choose, the biologically plausible 
inference options may include the linear, multistage, 
sublinear, and threshold models. A guideline usually 
prefers one option, although some guidelines permit the 
selection of more than one or of all the options. The 
preferred inference option may be viewed as a default 
option, i.e., the option chosen on the basis of risk 
assessment policy that appears to be the best choice in 
the absence of data to the contrary. A guideline may be 
said to be flexible according to the degree to which it 
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allows the default option to be superseded by another 
inference option as a result of convincing scientific 
evidence** 

Comparison of IRLG's guidelines with OSHA's guidelines 
illustrates how comprehensive and detailed guidelines 
have varied in flexibility. On the issue of benign versus 
malignant tumors, IRLG 1 s guideline stated: 

The induction of benign neoplasms would, therefore, 
be considered evidence of carcinogenic activity 
unless definitive evidence is provided that the 
test chemical is incapable of inducing malignant 
neoplasms. 

The guideline did not attempt to define the type of defin¬ 
itive evidence that would be needed to demonstrate that a 
M test chemical is incapable of inducing malignant neo¬ 
plasms." In contrast, OSHA created strict minimal 
criteria for acceptance of such evidence: 

(i) Benign tumors. Results based on the induc¬ 
tion of benign or malignant tumors, or both, will 
be used to establish a qualitative inference of 
carcinogenic hazard to workers. Arguments that 
substances that induce benign tumors do not 
present a carcinogenic risk to workers will be 
considered only if evidence that meets the 
criteria set forth in 1990.144(e) is provided. 

Section 1990.144(e) stated: 

(e) Benign tumors. The Secretary will consider 
evidence that the substance subject to the rule- 
making proceeding is capable only of inducing 
benign tumors in human or experimental animals 
provided that the evidence for the specific 
substance meets the following criteria: 

Criteria. (i) Data are available from at least 
two we 11-conducted bioassays in each of two species 
of mammals (or from equivalent evidence in more 
than two species). 


♦Flexibility is also intimately related to the legal 
weight that the agency desires a guideline to have; the 
implications for flexibility of adopting guidelines under 
different legal authorities are reviewed in the next 
section. 
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(ii) Each of the bioassays to be considered has 
been conducted for the full lifetime of the 
experimental animals. 

(iii) The relevant tissue slides are made avail¬ 
able to OSHA or its designee and the diagnoses of 
the tumors as benign are made by at least one 
qualified pathologist who has personally examined 
each of the slides and who provides specific 
diagnostic criteria and descriptions; and 

(iv) All of the induced tumors must be shown to 
belong to a type which is known not to progress to 
malignancy or to be at a benign stage when 
observed. In the latter case, data must be 
presented to show that multiple sections of the 
affected organ(s) were adequately examined to 
search for invasion of the tumor cells into 
adjacent tissue, and that multiple sections of 
other organs were adequately examined to search 
for tumor metastases. 


By leaving open the type of evidence needed to super¬ 
sede the default option (benign tumors should be consid¬ 
ered evidence of carcinogenic activity), IRLG allowed 
more flexibility than OSHA. 

In no case did the IRLG guidelines attempt to restrict 
the type of evidence that would be needed for acceptance 
of alternative interpretations. In contrast, OSHA speci¬ 
fied minimal criteria for acceptance of alternative 
interpretations on the issues of negative epidemiologic 
studies, proof of metabolic differences between animals 
and humans, and rejection of the use of data from testing 
at high doses. By invoking such criteria, OSHA attempted 
to limit the definition of acceptable interpretation and, 
in so doing, eliminate or reduce scientific debate on 
controversial issues in its rule-making proceedings. 

IRLG also created flexibility by not choosing a default 
option, i.e., by citing a range of possible inference 
options to be used in a risk assessment. The statement 
on interspecies conversion factors illustrates this point: 

Several species-conversion factors should be con¬ 
sidered in estimating risk levels for humans from 
data obtained in another species. 

All OSHA guidelines were restricted to the choice of a 
single inference option. 
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DEGREE TO WHICH GUIDELINES MAY BE BINDING 
ON AN AGENCY AND A REGULATED PARTY 


The guidelines developed by or for regulatory agencies may 
vary in their legal status and thus in their procedural 
implications. For example, OSHA's guidelines (1980) 
appeared as regulations formally published, after oppor¬ 
tunity for public comment, in the Federal Register, In 
contrast, EPA’s guidelines (1976), although eventually 
printed in the Federal Register, have never been offici¬ 
ally subjected to public comment and do not purport to be 
regulations. 

To appreciate the practical differences among the 
approaches that an agency might follow, it is useful to 
distinguish three types of administrative documents: 
regulations (or, synonymously, rules), established pro¬ 
cedures (a term we have devised to refer to agency pro¬ 
nouncements that are in some contexts referred to as 
guidelines ), and recommendations. There is no single 
authoritative definition of the latter two types of 
document. The discussion here is an attempt to reflect 
common understanding; it draws as well on the practice, 
but not the terminology of one agency, FDA (1982a) ,* An 
illustration will illuminate the practical differences 
among these three types of documents. Suppose that an 
agency decides to adopt, as one of its risk assessment 
guidelines, the default option that benign tumors should 
be aggregated with malignant tumors in determining whether 
a mammalian bioassay demonstrates that an agent causes 
cancer in the test species. This guideline could be 
adopted as a regulation, as what we term an established 
procedure, or simply as a recommendation. For internal 
purposes, it is not likely to matter which form the 


*FDA officially recognizes three types of documents: 
binding regulations, guidelines, and recommendations• 
That terminology is potentially confusing here, because 
we have given guidelines a special meaning, connoting 
codified principles for risk assessment, that diverges 
from FDA's legal definition. The reader is referred to 
the footnote at the beginning of this chapter for a more 
complete treatment of this discrepancy. We have there¬ 
fore coined the substitute phrase established procedures , 
to describe any standards of criteria for fulfilling a 
regulatory requirement that the agency commits itself to 
follow until they are formally revoked or revised. 
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agency* s guideline takes. If the guideline is understood 
to represent prevailing agency policy, the agency* s mana¬ 
gers can assume that assessors will adhere to it in eval¬ 
uating test data, regardless of its form. Important 
differences will be observed, however, in the guideline* s 
impact on interested third parties. 

If the guideline were adopted as a regulation, it would 
be reciprocally binding. Neither the agency nor any pri¬ 
vate party would be free to argue in a regulatory proceed¬ 
ing that benign and malignant tumors should never be 
aggregated or should not in a particular instance be 
aggregated? the agency* s regulation would render such 
arguments legally irrelevant. It is precisely this effect 
of regulations—i.e., their treatment of previously con¬ 
tested (and in theory still contestable) issues as author¬ 
itatively resolved—that OSHA sought when it published 
its risk assessment guidelines as regulations. 

If the guidelines were merely a recommendation, manu¬ 
facturers of chemicals under evaluation would not be bound 
by it. They could argue, to the agency or in courts that 
benign tumors should never be aggregated with malignant 
tumors or that they should not be aggregated in a particu¬ 
lar case. They might not convince the agency, but the 
agency could not lawfully refuse to consider their argu¬ 
ments or reject evidence supporting them, and they might 
convince a court that the agency guideline—i.e., its 
choice of inference options—is wrong generally or inap¬ 
plicable in a particular case. 

If the guideline were an established agency procedure, 
a private party could similarly argue that it is wrong 
generally or inapplicable to a particular case. An 
established procedure does not, therefore, preclude 
efforts by third parties to treat the benign-versus- 
malignant issue as an open question. The difference 
between a recommendation and an established procedure 
lies in the latter * s effect on the agency itself. An 
agency can depart from a recommendation at any time. 

Under FDA's practice, however, it may not depart from an 
established procedure unless it has previously announced 
that it no longer regards the procedure as sound. In 
other words, such an established procedure is binding on 
the agency until formally revoked or changed, and third 
parties can rely on it and insist that the agency adhere 
to it.* 


*The practical effects of the legal distinctions drawn 
here are possibly overdrawn. The flexibility accorded by 
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There is another important difference between regula- 
t ions and established procedures or, indeed, recommenda- 
i°ns. To adopt regulations that have the reciprocally 
finding effects described above, an agency must follow 
tne procedures prescribed by the Administrative Procedure 
ct, or by its own statute, for rule-making. At a mini¬ 
mum, these procedures include publication of a proposal, 
an opportunity f or the submission of public comments, and 
promulgation of a final document that discusses and 
responds to all significant comments. The process can be 
long and acrimonious, and that helps to explain why agen¬ 
cies sometimes choose not to adopt policies, particularly 
those addressing complex issues, in the form of regula¬ 
tions. The same process must be followed to effect 
changes in regulations once adopted, and that inhibits 
rapid response to changes in scientific understanding. 


ARGUMENTS FOR AND AGAINST THE USE OF GUIDELINES 

The advantages and disadvantages listed below constitute 
an inventory of arguments that have been brought forward 
by the proponents and critics of guidelines for risk 
assessment, in most cases, an argument is most convincing 
for guidelines of a particular form and content, rather 
than for guidelines in general. For these cases, the 
characteristics of guidelines that would support or 
refute an argument are indicated. 


any set of guidelines depends as much on the language 
chosen as on the legal form in which they appear. Suppose 
that an agency * s default option is: "Ordinarily benign 
and malignant tumors shall be equated and their sum used 
to determine the significance of observed effects, unless 
(a) new data suggest the inappropriateness of this prac¬ 
tice generally, or (b) results from the test in question 
or other tests of the compound make aggregation inappro¬ 
priate in the particular case." This text anticipates 
exceptions, and would not prevent either the agency or a 
third party from taking a different view about the meaning 
of a particular test, whether it appeared as a regulation 
or in some other form. 
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ADVANTAGES OF GUIDELINE USE 


Separation of Risk Assessment from Risk Management 

Proponents of guidelines argue that their use would help 
to separate risk assessment from other parts of the regu¬ 
latory process. They contend that, when selected infer¬ 
ence options are clearly delineated in a formal document, 
risk assessments will not likely be influenced to fit 
prior conclusions about regulation of a particular sub¬ 
stance. The use of guidelines can also dispel the appear¬ 
ance of such influence when, in fact, there is none. 
Agencies can defend their assessments on the grounds that 
they always do them in the way set forth in the guide¬ 
lines. Compared with reliance on the ad hoc selection of 
inference options, the use of guidelines could reduce the 
controversy focused on individual assessments. Debate 
will shift to the more general discussion of the generic 
choice of inference options addressed in the guidelines. 
Guidelines that are comprehensive and detailed will define 
and bracket the components of risk assessment most com¬ 
pletely and explicitly. Thus, such guidelines could 
probably provide the sharpest distinction between risk 
assessment and risk management. 


Quality Control 

Proponents of guidelines argue that their use would ensure 
the application of selected inference options based on the 
informed judgment of experts. A single risk assessment 
requires knowledge in diverse fields, such as epidemiol¬ 
ogy, biostatistics, toxicology, biochemistry, chemistry, 
and clinical medicine. Generally, assessors have advanced 
expertise in no more than a few fields. Guidelines could 
help to bridge gaps in knowledge by ensuring that deci- 
sions are based on j udgments formulated by experts in 
each subject. Guidelines could also help to ensure that 
assessors apply judgments that are in accord with current 
scientific thinking in each field. This argument high¬ 
lights the importance of including experts from a wide 
range of scientific disciplines in the formulation of 
guidelines. Furthermore, it suggests that guidelines 
should be reviewed periodically so that new scientific 
developments can be accommodated. 

Proponents believe that comprehensive, detailed guide¬ 
lines would be most helpful in providing guidance to 
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assessors* Comprehensiveness is necessary to provide 
guidance on all or most of the components of risk assess¬ 
ment* Detailed guidelines could provide an assessor with 
an expert*s insight into aspects of risk assessment that 
require special consideration* How flexibility could 
affect quality control is not clear; however, a flexible 
framework could have a positive effect, especially if 
guidelines can help an assessor to know when exceptional 
or novel scientific evidence should be admitted. 


Consistency 

Almost all guideline documents have stated, in their 
introductions, that consistency is a major rationale for 
guideline use. Consistency in risk assessment is impor¬ 
tant to the agencies, because it helps to ensure fairness 
and rationality by precluding the arbitrary application 
of selected inference options that differ from one time 
to the next. Consistency also permits comparison of risks 
associated with different chemicals, and this is useful 
for priority-setting and for facilitating regulatory 
decision-making. When the same set of guidelines is 
applied uniformly by all the agencies, government-wide 
consistency may be improved. This has important impli¬ 
cations for interagency coordination and for reducing the 
possibility that risk assessments by different agencies 
will be pitted against each other during litigation on a 
given chemical. Guidelines of a type that fosters consis¬ 
tency among agencies have yet to be adopted and used. In 
the absence of such guidelines, there are increased oppor¬ 
tunities for inconsistency in the choice of inference 
options available for each risk assessment component and 
in the conclusions based on those choices. Proponents of 
guidelines contend it is often difficult even to know 
whether there is consistency among risk assessments, 
because of lack of explicit documentation of inference 
options used. 

Comprehensive, detailed guidelines applied uniformly 
across the agencies appear to be the most suitable form 
for reducing inconsistency. To ensure thoroughness and 
clarity in drawing conclusions, assessors should explic¬ 
itly document the use of such guidelines in their reports. 
Flexibility does not imply inconsistency in the applica¬ 
tion of risk assessment policy. The same inference 
options can be applied consistently, except in instances 
where convincing contrary scientific evidence is pre- 
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sented. When such evidence is available, the choice of 
different inference options has a scientific rationale 
and does not imply an arbitrary shift in risk assessment 
policy. It is not the same kind of inconsistency as that 
which can occur when, for example, one assessor uses a 
species-to-human conversion factor based on surface-area 
ratios and another, for no better scientific reason, uses 
a factor based on body-weight ratios. 


Predictability 


Proponents of guidelines argue that the private sector 
should be told explicitly which inference options the 
government will select to evaluate health-effects data. 
Industry needs this information to assess its own activ¬ 
ities and testing programs. Without uniformly applied 
guidelines, a regulated party may have to call on the 
agencies for judgments on numerous issues and have no 
assurance that the judgments will not change unexpectedly 
or that one agency's judgment will be consistent with 
another's. Industry representatives have stated their 
preference for uniform federal guidelines (although they 
have been much more cautious in discussing the content of 
and legal weight given to the guidelines)• Consider, for 
example, the following comment by the American Industrial 
Health Council, regarding the publication of the IRLG 
cancer guidelines (AIHC, 1979) : 

The report is a significant step toward the 
formulation of a national cancer policy. AIHC 
supports the report's stated objective of ensuring 
that regulatory agencies evaluate carcinogenic 
risks consistently. We strongly urge that this 
initial step be followed up so that a national 
cancer policy is developed and conflicting policies 
among the regulatory agencies are minimized. 

This point of view takes on added significance in view of 
the increasing desire of some states to develop their own 
cancer policies. Six states have initiated programs thus 
far, and California has already published its own guide¬ 
lines (State of California, 1982a,b)• For the private 
sector to have to contend with a range of different poli¬ 
cies in different states would clearly be disadvantageous 
and burdensome. A federal cancer policy could serve as a 
model to the states and foster a more uniform approach to 
risk assessment. 
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Proponents believe that the most useful guidelines in 
gauging government actions would be detailed and compre¬ 
hensive. Although flexibility may undermine predictabil¬ 
ity, it is reasonable to assume that industry would 
welcome such a trade-off. Guidelines published as estab¬ 
lished procedures would be the best option, for the 
regulatory agencies would not change their procedures 
without formal notice, but the procedures would not be 
binding on the regulated parties. 


Evolutionary Improvement of the Risk Assessment Process 

Proponents of guidelines argue that their use provides a 
locus for debate, examination, and revision of the 
selected inference options generally used in risk assess¬ 
ment. By contrast, the argument proceeds, when chemicals 
are evaluated on an ad hoc basis, the focus of debate is 
shifted from generic issues to case-specific issues, and 
the methods and assumptions of risk assessment are 
obscured from critical view. 

Over the last decade, new and refined techniques of 
risk assessment have emerged. Two important examples are 
the use of short-term in vitro tests to infer carcino¬ 
genicity and mutagenicity and the use of dose-response 
assessment to estimate the magnitude of human risk at low 
doses. Guidelines may have contributed to the evolution 
of both by proposing generic interpretations that would 
be evaluated and tested both in theory and in the lab¬ 
oratory. The choice of a low-dose extrapolation model is 
a specific example. The first guidelines (FDA, 1973) 
proposed the use of the Mantel-Bryan model. This choice 
was the subject of much debate (FDA, 1977, 1979b) ? newer 
guidelines have suggested that this model has been dis¬ 
counted by the agencies, in part because it is essentially 
empirical and lacks biologic relevance with respect to 
current knowledge about carcinogenesis (IRLG, 1979b; EPA, 
1980a) • Furthermore, the debate over an appropriate 
model helped to foster a major research effort. The 
EDqi experiment, also known as the "megamouse study," 
involved the testing of 24,000 female mice given known 
carcinogens at low doses in an attempt to determine the 
shape of the response curve at low doses. 

Guidelines that are comprehensive and detailed would 
invite the most opportunity for debate and evolutionary 
refinement. 
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Public Understanding 

Because risk assessment is complex, it is easy to parody 
and demean the process. For example, the decision to 
label soft drinks containing saccharin was satirized in 
several highly publicized jokes, e.g., "Cautions Sac¬ 
charin is hazardous to your rat" and "Drink 800 bottles 
of pop a day and get cancer." Proponents of guidelines 
argue that comprehensive, detailed guidelines setting 
forth the scientific and policy bases of risk assessment 
could improve public understanding and help to dispel the 
impression that government actions are based on tenuous 
and inadequate reasoning. 


Administrative Efficiency 

Some contend that when risk assessments are performed on 
a chemical-by-chemical basis without the use of guide¬ 
lines, too many agency resources are devoted to reargu¬ 
ment of the same issues with regulated parties. For 
examples Should animal carcinogenicity data be used to 
assess human risk? Should data on animals with a high 
incidence of spontaneous tumors be considered valid? 
Should benign tumors be assigned the same weight as 
malignant ones? Which statistical methods should be 
applied? Guidelines could reduce repetitious discussion 
by specifying which types of interpretations are 
acceptable, given the current state of scientific 
understanding. 

OSHA, in its "Identification, Classification, and 
Regulation of Potential Carcinogens" (1980), registered 
concern about its efficiency (only seven rule-making 
proceedings completed in 9 years) and cited one major 
reason for its low productivity: 

The necessity to resolve basic scientific policy 
issues anew, in each rulemaking, has increased the 
burden on the Department of Labor and members of 
the scientific community called upon to address 
these widely accepted policies. Moreover, reliti¬ 
gation of these issues in the federal courts has 
also drained staff time and energy and has inhib¬ 
ited OSHA initiatives while its policy determina¬ 
tions were repeatedly relitigated. 
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OSHA maintained that the adoption of cancer guidelines 
was vital to efficient regulation: 

OSHA believes that this general policy and proce¬ 
dure will facilitate the sifting through the 
evidence concerning substances which may be 
interpreted to be potential carcinogens. . . . 

Without such a system and appropriate criteria/ 

OSHA believes that this task cannot be accom¬ 
plished in a timely cmd efficient manner. 

Efficiency could best be served by guidelines that are 
comprehensive/ detailed, and inflexible and are adopted 
as regulations binding on all parties, but this would 
entail other costs. The disadvantages of such guidelines 
are described in some of the agruments cited in the 
following discussion. 


DISADVANTAGES OF GUIDELINE USE 


Oversimplification 

The adoption of guidelines may foster a cookbook approach 
to risk assessment. The more assessors look at chemicals 
from a generic point of view, the less they are able to 
draw distinctions among them on the basis of specific 
data. The critics' ultimate concern is that blind adher¬ 
ence to guidelines might cause scientific information 
relevant to a particular chemical to be arbitrarily cast 
aside because it has not been accommodated in the 
guidelines. 

The following underlined phrases are examples of guide¬ 
lines that critics believe may lead to oversimp 1 ification; 

• Use of the most sensitive species to determine 
risk . Critics contend that, if information shows that 
metabolic similarity to humans is greater for a species 
that is less sensitive, data on this species may be 
preferable. 

• Absence of a threshold for carcinogenesis . 

Critics argue that tumors may be induced by a genetic 
mechanism or by an epigenetic mechanism. In the latter 
case, a threshold may exist. 

• Unqualified acceptance of positive results at 
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high-dose testing . Critics believe that validity should 
depend on whether there is a pharmacokinetic difference 
between high and low dose. Special consideration should 
be given to whether detoxifying or repair processes are 
saturated and to whether competing metabolic pathways are 
involved and become saturated. 

Another potential problem is the lack of attention to 
weighting of evidence. For example, a guideline may 
simply state that "positive results in animal tests 
should always outweigh negative results." This does not 
take into account the quality and statistical power of 
the different tests; it could foster the attitude that 
such considerations are of minor importance. 

To a large extent, the strength of such criticisms 
depends on the form and contents of the guidelines. 

Those which are comprehensive and leave little latitude 
for exceptional cases tend to maximize the problem of 
oversimplification; those which are flexible could be 
most effective in mitigating the problem. In addition, 
guidelines may explicitly direct the assessor to consider 
the weight of evidence of a given test result. For 
example, the IRLG guideline stated that positive results 
should supersede negative results, but added a caveat: 

" If the positive result is itself not fully conclusive or 
if reasons exist for questioning its validity as evidence 
of carcinogenicity, the result is generally classified as 
1 inconclusive 1 or 'only suggestive' even in the absence 
of other negative results." 

Detailed guidelines can reduce the possibility of over¬ 
simplification if the intent of detail is to capture for 
the assessor the complexity of the issue addressed. For 
example, a guideline might state the scientific basis for 
the chosen inference option, the kinds of evidence that 
are typically applicable, circumstances in which accep¬ 
tance of exceptional evidence may be appropriate, and 
other rationales for choosing a particular inference 
option. 

Regardless of the form of a guideline, there are some 
parts of risk assessment, particularly those dealing with 
the quality of data and the magnitude of uncertainty, that 
defy or at least resist generic interpretation. Individ¬ 
ual judgment is most important in such cases. A guide¬ 
line should not be viewed as a formula for producing risk 
assessments without the need for such judgment. 
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Mixing of Scientific Knowledge and Risk Assessment Pol] 

Guidelines unavoidably embody both scientific knowledge 
and risk assessment policy. In the past, regulatory 
agencies typically used a conservative approach in the 
development of risk assessment policy, as in the choice 
of the most sensitive species, use of the most conserve 
tive dose-response curve, and the lack of acceptance of 
negative epidemiologic data. Industry has been highly 
critical of this approach. Some representatives belie\ 
that risk assessment should be solely a scientific func 
tion and should be separated from policy decisions. 
Consider, for example, the American Industrial Health 
Council's criticism of the IRLG guidelines (AIHC, 1980) 

When the IRLG report speaks of the importance of 
using conservative methods or assumptions so as 
not to underestimate human risk, the report is 
mixing regulatory considerations into the scien¬ 
tific function. The scientific determination 
should be made separately from the regulatory 
determinations. On the basis of the best scien¬ 
tific estimate of the real risk, the regulatory 
agency can then consider costs, benefits and other 
elements that enter into a regulatory 
determination. 

Furthermore, there is a fear that the mixing will go 
unrecognized outside the scientific community (AIHC, 
1980) s 

When value judgments are formalized by the selec¬ 
tion, for "conservative" reasons, of a mathematical 
model or an assumption used for extrapolating human 
risk, the fact that value judgments have been made 
escapes the regulator and the public. 

The first criticism appears to miss the crucial fact tl 
r isk assessment must always include policy, as well as 
science. The important issues are what the risk assesi 
ment policy content is and whether it will be applied 
consistently or not. The second criticism is most app, 
cable to guidelines that permit an agency to represent 
science the conclusions that have been reached in part 
the basis of policy considerations. The argument is 1 
applicable to guidelines that explicitly distinguish 
between scientific knowledge and risk assessment polic 
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and direct the assessor to address such distinctions when 
reaching conclusions. Furthermore, it is not clear that 
risk assessment performed on an ad hoc basis would reduce 
the opportunity for unrecognized mixing of science and 
policy? indeed, carefully designed guidelines could help 
to inhibit such mixing• 

Guidelines very different from the kinds described 
could be designed to be devoid of risk assessment policy 
choices. They would state the scientifically plausible 
inference options for each risk assessment component 
without attempting to select or even suggest a preferred 
inference option. However, a risk assessment based on 
such guidelines (containing all the plausible options for 
perhaps 40 components) could result in such a wide range 
of risk estimates that the analysis would not be useful 
to a regulator or to the public. Furthermore, regulators 
could reach conclusions based on the ad hoc exercise of 
risk assessment policy decisions. 


Misallocation of Agency Resources to Development 
and Amendment of Guidelines 


Critics contend that the dedication of time and resources 
to the process of guideline development and amendment 
detracts from an agency's ability to conduct regulatory 
activities. For example, OSHA's cancer guidelines 
required 3 years of effort before promulgation of the 
final rule in January 1980. The full rule-making record 
eventually exceeded 250,000 pages. OSHA itself offered 
some 45 witnesses who addressed the scientific content 
and the policy implications of the proposal, and a much 
larger number of witnesses appeared in behalf of other 
participants. The final policy consisted of more than 
280 Federal Register pages of preamble and a dozen pages 
of regulatory text. Notwithstanding this intensive 
effort, the guidelines have yet to be applied, and new 
leadership at OSHA is in the process of reevaluating some 
provisions of the standard. 

The procedures required by the Administrative Proce¬ 
dure Act are so elaborate that development and amendment 
of guidelines written as regulations are expected to 
demand more intensive effort than guidelines written as 
established procedures or recommendations. Regardless of 
the legal status given to the guidelines, their stability 
over time is susceptible to major changes in policy 
stances. However, guidelines that clearly distinguish 
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scientific knowledge from risk assessment policy judg¬ 
ments could provide a locus for facilitating changes ii 
policy orientation. They would define elements of risk 
assessment policy that are amenable to change and scier 
tific elements that should not be changed for policy 
reasons. When risk assessment is done on an ad hoc 
basis, such distinctions may not exist. 


Freezing of Science 

Critics believe that guidelines would hinder the timely 
incorporation of important new scientific evidence durii f 
standard-setting. The Dow Chemical Company raised this 
concern about OSHA* s cancer guidelines (OSHA, 1980): 

The record • . . has now made it clear that there 
is absolutely no assurance that the latest scien¬ 
tific evidence in the field will be permitted to 
be applied under the proposal to any given 
regulation of a specific chemical substance. 

OSHA responded to this criticism by incorporating thi e 
amendment procedures into its cancer policy: a general 
review of the guidelines every 3 years by the directors 
of the National Cancer Institute, the National Institute 
of Environmental Health Sciences, and the National Inst; 
tute for Occupational Safety and Health? recommendatioi 
at any time from the National Cancer Institute, the 
National Institute of Environmental Health Sciences, or 
the National Institute for Occupational Safety and Healt ? 
and petitions from the public. Final amendments would 
occur only through formal, independent rule-making, to 
ensure that major changes in the guidelines would not be 
made during the litigation of individual cases. In indu - 
try's perception, the amendment provision did not answer 
its initial criticism. The American Industrial Health 
Council characterized the amendment procedures as "a 
time-consuming and ponderous mechanism for incorporating 
into the regulatory standards newly available evidence c 
data concerning heretofore unresolved issues" (OSHA, 

1980) . 

This argument is most applicable to guidelines that 
are adopted as regulations and to those which are compre 
hensive and inflexible. When guidelines are flexible an 
adopted as established procedures or recommendations, th 
rapid incorporation of novel scientific information is 
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more easily accommodated. The intent of flexibility is 
to allow the acceptance of exceptional evidence based on 
convincing scientific justification. In the case of 
established procedures or recommendations, changes in 
guidelines could occur without the necessity of a lengthy 
rule-making process. 


CONCLUSIONS 

On the basis of its review of the historical record of 
guideline development and use and its evaluation of the 
arguments for and against guideline use, the Committee 
has drawn several conclusions. 

1. All agencies have found it necessary to write 
guidelines, in part, to make their choice of inference 
options more evident to the public. However, the appli¬ 
cation of inference options to specific risk assessments 
has been marked by a general lack of explicitness. 

Because of the lack of explicitness in identifying the 
choice of inference options in specific risk assessments, 
it has often been difficult to know whether assessors 
adhere to guidelines. Within a given program, a consis¬ 
tent set of selected inference options may emerge over 
time. However, the degree of consistency among programs 
and agencies is not well defined. 

2. Agency guidelines have varied markedly in form and 
content. Without a deliberate coordinating effort, there 
is no reason to assume that guidelines will become more 
nearly uniform. 

Although the scientific bases of cancer guidelines 
developed in the past by the agencies have been generally 
consistent, the degree to which the guidelines are compre¬ 
hensive, detailed, flexible, and legally binding has 
varied widely. EPA's guidelines are statements of broad 
principles covering a few components in the four steps of 
risk assessment; they have no regulatory status. OSHA 1 s 
guidelines were comprehensive and detailed and dealt 
mainly with hazard identification; they were regulations. 
CPSC 1 s guidelines were not comprehensive and dealt mainly 
with hazard identification; they had no regulatory status. 
FDA's proposed sensitivity-of-method guidelines are com¬ 
prehensive and detailed for dose-response assessment and 
exposure assessment; they are regulations. The formation 
of the IRLG caused the agencies to adopt a single set of 
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guidelines for the first time, but, since its disbandin 
in 1981, there has been no further progress on guidelin 
development,* 

3. Uniform guidelines for risk assessment (except f r 
exposure assessment) are feasible and desirable. 

Guidelines are feasible. The Committee believes tha 
current statutory requirements would not prevent the us 
of uniform guidelines. Regulators administer laws ref 1 si¬ 
ting social policies that suggest different degrees of 
acceptable risk. Some argue that uniform guidelines wo Id 
keep regulators from applying different standards of ri < 
that were based on these laws. However, regulators can 
apply such standards on the basis of risk management 
decisions after completion of the risk assessment. Fur 
thermore, feasibility has already been demonstrated by 
the adoption of the IRLG guidelines. 

Uniform guidelines are desirable for several reasons 
First, the use of different guidelines by the agencies 
could undermine the credibility of their risk assessmen s • 
Critics of an agency risk assessment might argue persua 
sively that another agency estimates risk differently, n 
the basis of a different set of inference options. 

Second, almost every regulated chemical is in the juris 
diction of two or more agencies, and the possibility of 
duplication of effort in performing risk assessments on a 
given chemical could be minimized if the guidelines wer 
applied uniformly. Adoption of uniform guidelines coul 
foster joint risk assessment efforts by agencies inter¬ 
ested in regulating the same chemical; or one agency co Id 
rely on the assessment of another agency. Through such 
cooperative efforts, a small agency like CPSC, which 
lacks the scientific capability of EPA and FDA, could 
gain help in evaluating complex data. Third, governmen - 
wide guidelines could help industry to gauge government 
actions and to define the types of data and interpreta¬ 
tions relevant to industries' own testing programs. 

Fourth, federal policy could orchestrate efforts toward 
uniformity among the states. 


*The Office of Science and Technology Policy (OSTP), wi h 
agency participation, has written a document describing 
the scientific basis of risk assessment. OSTP envision 
the ultimate evolution of a set of principles for risk 
assessment from this document. 
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Exposure guidelines, in contrast with guidelines for 
other risk assessment steps, are not now readily amenable 
to uniform application in the various agencies. Apart 
from EPA, the agencies have rather narrowly defined 
interests regarding exposure, i.e., foods and drugs at 
FDA, consumer products at CPSC, and occupational hazards 
at OSHA. Whereas guidelines for the identification of 
hazard and for the quantitative estimation of risk in 
test animals may be commonly applied, no such common 
basis exists for applying exposure assessment guidelines. 

4. Even well-designed guidelines may be unsuccessful 
unless ; 

• Attention is given to the process by which 
they are developed . 

• They can accommodate change . 

• They are viewed as valuable tools, rather than 
formulas for producing risk assessments. 

Because guidelines must include both scientific knowl¬ 
edge and policy judgments, designing a development pro¬ 
cedure is a difficult task. Risk assessment requires 
advanced knowledge in a number of disciplines, and guide¬ 
lines should be formulated in part on the basis of the 
best possible scientific expertness in those disciplines. 
The best mechanism for determining risk assessment policy 
must be carefully defined. Because of the necessity of 
considering policy aspects in guidelines, duly appointed 
public officials must take responsibility for the policy 
implications. A major goal of the development process 
should be the assurance that the guidelines preserve a 
sharp distinction between scientific knowledge and risk 
assessment policy. 

The Committee believes that guidelines should be 
capable of accommodating evolving scientific concepts in 
two ways. First, they should be periodically reviewed 
and, if necessary, revised. Second, they should permit 
acceptance of new evidence that differs from what was 
previously perceived as the general case, when scientifi¬ 
cally justifiable. However, an unavoidable trade-off 
results from the use of such flexible guidelines: 
predictability and consistency may be reduced for the 
sake of flexibility. 

Every risk assessment involves consideration of case- 
specific factors, such as the quality of the data or the 
overall strength of the evidence. These factors cannot 
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be addressed effectively in guidelines. If assessor: 
were to use guidelines in a strictly mechanical fash, m, 
without recognizing the importance of case-specific 
judgments, the quality of risk assessments could be 
diminished. 

5. Uniform guidelines for effects other than can< r 
are desirable, but typically they would be based on < 
less extensive scientific data base. 

The same reasons enunciated for the desirability < 
cancer guidelines impel the conclusion that guideline 
are needed to guide assessments of other effects. S< en- 
tific data available on these effects may be organize to 
provide useful information for assessing risk. In f< t, 
guidelines have already been developed for some of tl: se 
(although never adopted by the agencies), i.e., guid< .ines 
for mutagenesis (EPA, 1980? March of Dimes Birth Defe ts 
Foundation, 1981) and guidelines for reproductive anc 
teratogenic effects (ORNL/EPA, 1982; March of Dimes E rth 
Defects Foundation, 1981). 
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Organizational Arrangemei ts 
for Risk Assessnu nt 


The different structures, procedures, and histories o: 
the agencies responsible for regulating toxic substanc ss 
have produced diversity in their approaches to risk 
assessment, but common patterns can be discerned, and 
they permit some broad generalizations about agency 
organizational arrangements. 

First, most agencies have exerted little effort to 
maintain a sharp organizational separation between 
employees engaged in assessing the risks associated w: :h 
substances and those responsible for identifying and 
evaluating regulatory responses. This is not to sugg< $t 
that the same persons perform both functions? general] ', 
they do not, for agency organizations reflect conside] ■ 
able specialization, recognizing the distinctive trair ng 
and capabilities of staff members. However, the two j mo¬ 
tions are often housed in one organizational unit that is 
responsible for preparing integrated analyses that inc >r- 
porate assessments both of risk and of recommended rec la- 
tor y responses. Sometimes, risk assessment staff are 
employed in an office that is separate from the office of 
those who formulate and analyze regulatory options, bt , 
with some notable exceptions, this organizational stru - 
ture does not lead to a rigid separation of the two 
staffs. 

Second, with the exception of a few experiments in 
interagency risk assessment during the late 1970s and 
continuing informal exchanges of information, each age cy 
has performed its own assessments of the risks posed fc 
substances that are candidates for regulation. This 
operational autonomy does not reflect willful ignoranc 
of the activities of sister agencies or indifference t 
the desirability of consistency in the evaluation of 
common candidate substances. Rather, it is a product f 
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several factors, including the lack of obvious mechanisms 
for formalized interagency collaboration, the desire of 
agency policy-makers to reserve authority for policy dis¬ 
cretion in reaching conclusions based on risk assessment, 
the perception that the diversity of types of exposure 
for which each agency is responsible makes collaborative 
risk assessment impractical, and differences in regula¬ 
tory priorities and schedules. 

Third, although the four agencies have viewed them¬ 
selves as ultimately responsible for the risk assessments 
that support their actions, they often extend their own 
staff resources available for performing risk assessment 
by relying on consultants and contractors who are closely 
supervised by agency personnel. Some agencies—notably 
the Occupational Safety and Health Administration (OSHA) 
and the National Institute for Occupational Safety and 
Health (NIOSH)—whose staffs are small or lack needed 
expertise rely very heavily on nongovernment contractor s 
and outside scientists in the academic community and 
government research institutions for performance of risk 
assessments or specific tasks related to risk assessment 
(such as literature reviews)• 

In addition, outside scientists are often called on to 
review assessments produced by agency staff. Such consul¬ 
tations sometimes take place informally, but often through 
special advisory committees. These committees can be per¬ 
manent, such as the Environmental Protection Agency (EPA) 
Clean Air Science Advisory Committee, or can be created 
to review particular risk assessments, as is done for many 
of the Food and Drug Administration (FDA) Bureau of Foods 
assessments. Some are established by statute, with 
requirements that they review agency assessments before 
regulations are proposed. Others are created voluntarily 
by an agency itself. The members of all federal advisory 
committees are appointed by the agencies, perhaps with 
the approval of higher executive-branch authority. Can¬ 
didates for committee membership usually are identified 
by agency staff, although some agencies seek nominees from 
professional organizations and other interested parties. 
Nominations for some statutorily mandated committees are 
supplied by an external body, such as the National Academy 
of Sciences or the National Science Foundation. Advisory 
panels generally exercise considerable influence and, 
although legally they are only advisory, share to some 
extent the agencies' authority to reach conclusions about 
risk. 
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TYPES OF ORGANIZATIONAL ARRANGEMENTS 

The prominent proposals for reforms in organizational 
structures and procedures for risk assessment have 
featured three interrelated principles: 

• Risk assessment activities should be strictly 
separated from the analysis of risk management options 
and selection of regulatory strategies* 

• Risk assessment activities should be centralized 
in a single body that serves all regulatory agencies* 

• Expert panels composed of nonagency scientists 
should be used either to perform risk assessments for an 
agency or to review assessments developed by agency staff. 

The Committee outlined four idealized models that 
reflect various combinations of these three principles. 

The models are integration, intra-agency separation (with 
or without centralization), extra-agency separation (with 
or without centralization), and use of scientific review 
panels. Examples of agency organizations that roughly 
approximate each model are identified below and in Table 
III-I. Most of the examples chosen have many distinctive 
characteristics that obscure or at least outweigh the 
three organizational principles. In addition, they are 
not the only examples of a particular model; others could 
have been reviewed.* 


INTEGRATION 

In this type of arrangement, a single organizational unit 
both performs risk assessments and develops regulations. 
In general, this arrangement is the most common for regu¬ 
latory programs. For example, for the assessment of 
chronic hazards involved with chemicals from consumer 
products, the Consumer Product Safety Commission (CPSC) 


*The Committee considered the possible merits of reviewing 
risk assessment procedures used by other countries as well 
and decided not to pursue this line of investigation, 
because of the great differences in political and institu¬ 
tional structures between this country and other coun¬ 
tries. Such differences would make it very difficult, if 
not impossible, to extrapolate findings on institutional 
structures used in other countries to the United States. 
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Directorate for Health Sciences is the responsible ur t. 
Before 1977 r the Directorate for Health Sciences had ew 
people involved in the risk assessment process, and r sk 
assessments as such were not generally used. Since t en, 
the Directorate has acquired the expertise needed to *r- 
form risk assessments itself. The risk assessment is 
performed within the Directorate, which is distinct f m 
the Commission's politically appointed policy decisic - 
makers. Two different examples of this model examine by 
the Committee are the OSHA Directorate of Health Stan ards 
Programs and the FDA Bureau of Foods (Table III-l) • i 
the former example, risk assessors and those responsi Le 
for formulating and recommmending regulatory strategi 3 
are in the same organizational unit. FDA's Bureau of 
Foods has a separate office that performs risk assess: snt, 
but this separation stems from a functional division : 
scientific disciplines; it is not intended to and doe 
not result in formal separation of the risk assessmen 
staff from the regulatory staff. 


INTRA-AGENCY SEPARATION 

In this model, risk assessment is performed by a grou] 
that is ostensibly separate from and independent of tt 
office responsible for regulation in the same agency. An 
intra-agency risk assessment unit could be program- 
specific or agency-wide. There are examples of progr* - 
specific, organizationally separate risk assessment ur ts 
(notably the Environmental Criteria and Assessment OfJ ces 
in EPA) , but the Committee did not examine them; inste d, 
it reviewed activities of the EPA Carcinogen Assessmer 
Group as an example of an internally separate, agency¬ 
wide body. 


EXTRA-AGENCY SEPARATION 

In this model, an agency' s risk assessment is develope 
outside the agency. The examples reviewed demonstrate 
the wide variety of arrangements included in this mode . 
Full organizational separation can be achieved by havi j 
one institution perform risk assessment and a separate 
institution regulate exposure to hazardous substances. 
The relation between NIOSH and OSHA was studied as an 
example of a permanent, statutory arrangement of this 
kind. A regulatory agency's use of expert panels to 
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perforin risk assessments can also result in extra-agency 
separation of risk assessment and regulation. Committees 
of the National Research Council and several groups of 
panels used by FDA to review the safety and effectiveness 
of drugs provide varied examples of such arrangements. 

The National Toxicology Program Panel on Formaldehyde is 
an example of an ad hoc assessment group that consisted 
of government scientists, was organizationally separate 
from the regulatory agencies (although not without agency 
members), and served all four agencies (i.e., it was 
centralized) • Because the Interagency Regulatory Liaison 
Group did not perform risk assessments, it has not been 
examined as an example of an extra-agency assessment body. 


USE OF SCIENTIFIC REVIEW PANELS 


Agencies may use independent scientific panels to perform 
risk assessments or to review assessments prepared by the 
agencies. This distinction has been used by the Committee 
to facilitate separate discussion of panels that perform 
assessments as examples of full organizational separation 
(see preceding discussion) and panels that review agency 
assessments as examples of independent review panels. 
However, the dichotomy is somewhat artificial, in that 
there may be difficulty in classifying a particular panel. 
For example, if a panel responsible for performing risk 
assessments comes to rely heavily on preliminary analyses 
prepared by agency staff, it can be thought of as acting 
in a review capacity. Conversely, panels assembled solely 
for the purpose of reviewing agency assessments have often 
displayed remarkable independence, sometimes preparing 
long critiques of agency documents and suggesting sub¬ 
stitute findings and reasons. In such cases, to specify 
which group had performed and which had reviewed the 
agency's final assessment of risk is difficult. 

The extent to which agencies have used independent 
scientific panels has varied considerably. For example, 
OSHA has available two types of advisory committees: 
standing bodies, such as the National Advisory Committee 
on Occupational Safety and Health, and ad hoc committees 
that provide advice on specific standards. Members of 
both types of committee are expected to be knowledgeable 
about occupational safety and health and may include 
persons mainly interested in law or regulatory policies. 

In addition to their professional expertise, however, 
members of OSHA committees are intended to be represen- 
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tative of groups interested in occupational health an 
safety. Several committees have reviewed risk assess 
ments prepared by OSHA or NIOSH. However, because me; 
bers were intended to be representatives of interest 
groups, reviews were usually forums for policy debate: 
not scientific evaluations of risk assessments. In i 
initial years, OSHA routinely appointed an advisory 
committee for each regulatory proceeding. 

CPSC has had the least experience with expert pane] 
Before 1981, the Commission was not required to have < 
assessment of carcinogenic hazard reviewed by an outsj 
panel, although it did make occasional use of such pai 
(most notably CPSC s s request for the National Toxicolc 
Program to form a panel on formaldehyde). CPSC's real 
rization in 1981 included a provision that, before anj 
regulatory action could be proposed on a substance pot 
tially presenting a carcinogenic, teratogenic, or muta 
genic hazard, a chronic hazard advisory panel (CHAP) n 
be established, with the cooperation of the National 
Academy of Sciences, to review the toxicity of the sub 
stance. The first CHAP has recently been convened to 
review the toxicity of asbestos. Thus, CPSC relies on 
two methods of peer review for any proposed action. 
First, independent peer review by outside experts, as 
well as by a scientific review panel, is performed befi 
a notice of proposed rule-making is issued. Second, t 
Commission relies on a public rule-making proceeding i 
accordance with the Administrative Procedure Act durin 
which comment is invited through a Federal Register no 
on all aspects of the proposed action. Extensive writ 
comments have been received in the past by this proced 
from industry, consumer groups, members of the academi 
and scientific communities, and others. Additionally, 
open, informal public hearings may be held in which in 
ested groups present their views orally; in the past, 
several such hearings were held during the considerati 
of a single substance (formaldehyde)• 

FDA has often used independent scientific panels be 
to perform and to review agency assessments. The Bur 
of Drugs has used standing committees to review and ev 
uate data on the safety and effectiveness of drug prod 
and to make appropriate recommendations to the Commis¬ 
sioner (see preceding discussion) . The use of indepen 
dent panels by the Bureau of Foods, however, has been 
an ad hoc basis, usually at the agency* s discretion. 
However, there are exceptions; for example, the Food, 
Drug, and Cosmetic Act requires that carcinogenicity 
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issues related to color additives be referred to a com¬ 
mittee of experts selected by the National Academy of 
Sciences. 

EPA, in contrast, has had less choice in its relations 
with its advisory committees. Several statutes require 
EPA to consult such committees for scientific review of 
agency risk assessments or regulations. Examples of 
mandated advisory committees with a primarily scientific 
role include the Agency-wide Science Advisory Board; the 
Clean Air Scientific Advisory Committee, a part of this 
Board, which reviews criteria documents for air-quality 
standards; and the Scientific Advisory Panel, which 
focuses on scientific issues in the Agency*s Office of 
Pesticide Programs. The Committee has examined this panel 
and a subcommittee of the Science Advisory Board as 
examples of scientific review panels. 

Agency actions, including risk assessments, have been 
reviewed in the Executive Office of the President; how¬ 
ever, because these reviews have, with a few notable 
exceptions, focused primarily on risk management con¬ 
cerns, the Committee has not examined them. 


REVIEW OP AGENCY PROCEDURES FOR RISK ASSESSMENT 


This section describes the practices used for risk 
assessment in each of the organizational examples 
reviewed by the Committee. The descriptions that follow 
reveal some strengths and weaknesses of particular 
approaches and permit some tentative generalizations to 
be made. Such generalizations, augmented by the experi¬ 
ence and judgment of Committee members, lead in turn to 
recommendations applicable to organizational arrangements 
for the performance of risk assessment. 

The Committee* s necessarily retrospective review of 
agency performance has focused on events and practices of 
the 1970s, which triggered the current proposals for 
reform. Changes have been implemented, or at least are 
contemplated, in the procedures of several of the agen¬ 
cies studied, and the Committee recognized that such 
changes could alter the performance of risk assessment. 
Some of the descriptions of agency practices presented 
here may be dated. However, our purpose is not to des¬ 
cribe the current organizational structure of agencies, 
but rather to discern in the historical record any gen¬ 
eral relationships between organizational design and 
procedures and the quality of risk assessments. The 
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paucity of experience with recent organizational chan es 
and the tendency of any new administration to disclai 
the approaches of predecessors while proclaiming the 
effectiveness of reforms make very recent history les 
germane to the Committee’s purpose. 


OSHA 8 S DIRECTORATE OF HEALTH STANDARDS PROGRAMS (DHSP) 

OSHA's health standards were expected by Congress to l s 
based on criteria and recommended standards provided 1 r 
NIOSH. However, improvements in OSHA ? s scientific caj t- 
bility and a court directive that OSHA itself review « .1 
studies included in the risk assessment supporting a 
proposed standard prompted the agency to rely less he< 'ily 
on NIOSH and to begin performing its own risk assessmc ts. 
Until 1976, OSHA had only a few personnel in the healt . 
sciences? however, DHSP has since become an organizati n 
staffed primarily by health professionals, including 
industrial hygienists, responsible for performing risk 
assessments and for preparing standards, relying on 
economic and technical analyses supplied by the Office of 
Regulatory Analysis in a separate directorate (Figure 
III-l). In addition, the Directorate normally has use a 
number of consultants who assist with risk assessment r 
other aspects of standard development, contributing 
considerable specialized expertise to the organization 
OSHA tried to achieve organizational separation of 
risk assessment from the preparation of standards in t e 
case of carcinogens. One office in DHSP was supposed o 
do risk assessment, another to draft standards. In pr 3- 
tice, however, such separation was not achieved, large { 
because personnel shortages required that individual 
staff members perform both functions. 


Agenda and Procedures 

DHSP 1 s regulatory and risk assessment agenda has been 
determined largely by two external forces: petitions 1 r 
labor unions for action on particular hazards and dram :ic 
discoveries of previously unidentified workplace hazart i. 
Court remands of several OSHA standards, such as the b< i- 
zene standard, provided new work for OSHA, but none of 
the mandated re-examinations has led to a final standa] l. 
Criteria documents prepared by NIOSH also contributed t > 
OSHA* s agenda, in that DHSP staff always read these do< r 
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merits when they were received and normally published 
Federal Register notice soliciting further informatio , 
DHSP 9 s risk assessments usually began with a NIOSH 
criteria document or other NIOSH input, whatever info, 1 a- 
tion was submitted with a labor petition if there was 
one, the data available from any precipitating discov* y, 
and assessments performed by others, such as the Natic al 
Academy of Sciences. A literature search and review \ >re 
conducted by DHSP personnel, often with the help of cc - 
sultants and NIOSH personnel; and sometimes environmei al 
data on the workplace were solicited or obtained by 
contractors to contribute to the exposure assessment. 

DHSP has not prepared special assessment documents 
before issuing notices of proposed rule-making. Thus, 
the first indication provided to the public of the res Its 
of an OSHA risk assessment and of the conclusions it 
intended to draw therefrom was in the Federal Register 
preamble to its proposed standard. Public comment was 
invited on all aspects of the proposed standard, inclu - 
ing the risk assessment. Extensive written comments w re 
usually received from industry, labor, and others, sue 
as members of the academic scientific community. Cus¬ 
tomarily a hearing was held at which oral presentation 
were made and at which questioning of witnesses by OSH 
personnel and other witnesses was permitted. The prea >le 
to the final rule, if one were issued, included OSHA's 
final risk assessment, which incorporated a literature 
review and OSHA 1 s conclusions on the available scienti Lc 
data. 

In 10 years, OSHA produced permanent health standar i 
for 23 substances or processes, 14 of which were regu¬ 
lated together in a single rule-making. OSHA has also 
proposed standards for eight substances for which final 
standards have never been issued, and assessments were 
conducted for several substances for which new or updat d 
standards are now being considered (Table III-2)• 


Methods and Use of Guidelines 


For most of its history, OSHA has not had formal guide¬ 
lines for carcinogenic risk assessment. Instead, agenc 
staff have conducted their assessments by choosing opti is 
for the components of risk assessment on a case-by-cas€ 
basis. However, the generic guidelines for identifica¬ 
tion and classification of carcinogens proposed in 197*3 
and revised and promulgated in 1980 were intended to 



TABLE III-2 A Summary of OSHA Standards 


Standards 

Completed 

Standards 
Proposed, But 

Not Completed 

Standards 

Being 

Developed 

Asbestos 

Arsenic^ 

Ethylene oxide 

Vinyl chloride 

Beryllium 

Asbestos 

Arsenic^ 

Sulfur dioxide 

Ethylene dibromide 

Benzene 

Ketones 

Cotton dust, 

Coke-oven 

Hearing con¬ 

nontextile 
sectors 

emission 

servation 


14 carcinogens 

(noise) 

Toluene 


Lead 

Ammonia 


Cotton dust 

MOCA 


l,2-Dibromo-3- 

chloropropane 

Trichloro- 


Acrylonitrile 

ethylene 



^The arsenic standard was remanded to OSHA by the Court 
of Appeals for the Ninth Circuit for purposes of making a 
significant-risk determination consistent with the 
Supreme Court*s benzene decision. 


replace criteria used in individual cases with generic 
guidelines that would be applied consistently to all risk 
assessments of potential carcinogens. The choices incor¬ 
porated in the 1980 cancer policy reflected the policy 
orientations of incumbent senior agency officials. 

Changes now contemplated in these guidelines reflect the 
policy orientation of the current OSHA management. Sim¬ 
ilarly, although for many years OSHA did not perform 
quantitative risk estimates for use in setting standards 
for carcinogens, it now intends to do so where appropri- 
ate. This change results from policy decisions of senior 
agency officials, based, at least in part, on their inter¬ 
pretation of the Supreme Court's decision on benzene. 
(Agency officials have interpreted the decision to mean 
that quantitative dose-response assessments should be 
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performed for individual substances if data are 
sufficient.) 


Peer Review 


OSHA historically has done a less thorough job than : 
agencies in obtaining relevant scientific informat d 
and independent peer review of this information bef c 
issuing a notice of proposed rule-making. Instead, : 
agency has relied primarily on the public rule-maki j 
proceeding to identify new information, much of whic \ 
in the possession of interested parties and is unlil \ 
to be brought forward except in the context of rule- 
making. Similarly, although NIOSH's and OSHA's inil 
assessments often did not provide a critical review 
relevant data, critiques of this information were gi 
to the agency during rule-making proceedings, and th 
agency's final assessment of the risks posed by a ch 
cal often was substantially changed as a result. OS 
use of rule-making proceedings to provide scientific 
review stands in sharp contrast with the other agenc 
procedures for review. In the Committee's opinion, 
reliance on public proceedings to strengthen and ref, 
the scientific basis for the agency's regulatory act 
has not been an adequate substitute for independent \ 
review. In addition, reliance on public proceedings 
surely precipitated some of the criticism of agency 
actions and may have jeopardized the scientific intec 
and procedural legitimacy of the agency's risk assess 
ments. 

Although OSHA's standard-setting actions have stiir 
lated intense controversy, much of it has focused on 
issues separate from risk assessment. Questions of c 
and technologic feasibility (risk management issues) 
stimulated much debate. Discussions of the agency's 
assessments have usually focused on its conclusions a: 
their relationship to the agency' s regulatory mandate 
rather than on its characterization of risk. When 0S1 
risk assessments were challenged during rule-making, 
key subjects of contention were OSHA's adherence to t) 
assumption that carcinogens have no threshold for cau 
adverse effects, its tendency to give positive data 
greater weight than negative data, its use of single 
demiologic studies to support regulatory action, the 
validity of specific experiments and the agency's int 
pretation of the data from them, and the decision as i 
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quantitative assessments of risk should be con- 
• These issues, of course, have both policy and 
fic implications. 


UREAU OF FOODS 


d and Drug Administration enforces the Federal 
rug, and Cosmetic Act and several related statutes. 
isdiction ranges from basic foods to the most 
d pharmaceuticals and medical equipment. The 
assesses the risks associated with thousands of 
existing products every year, functioning through 
-oriented units whose responsibilities are reflec- 
their titles: Foods, Drugs and Biologics, Veteri- 
dicine, and Devices and Radiological Health (Figure 
The bureaus' agendas are dictated both through 
1 planning and by external events, particularly 
tions for approval of new products. Because the 
of Foods has had considerable experience with 
s that pose potential cancer risks, the Committee 
used on this part of FDA in its review. 


and Procedures 


eau's risk assessment functions fall into three 
ategories: review of petitions for marketing of 
pounds for which the manufacturer provides sup- 
toxicologic and exposure (or use) data; planned 
ective or cyclic review of approved compounds, 
ing data on which the Bureau generally must take 
inds them; and review of inadvertent contaminants 
, supporting data on which are derived from many 
, including open scientific literature, monographs, 
, manufacturers' data, and agency-generated data. 
981, the Bureau of Foods evaluated 65 food addi- 
two color additives, and approximately 45 animal- 
titions. These totals, however, do not reveal the 
umber of Bureau inquiries that could qualify as 
sessments, albeit perfunctory. Each time a new 
ant is discovered, for example, the Bureau per- 
ome assessment of the risks, although the avail- 
ta are often limited and little time is available 
er data before it must decide whether to initiate 
measures. Similarly, every reported change in 


100 



101 


degree of contamination invites a new risk assessment. 

As one would predict, the time and effort required vary 
with the context. The Bureau's procedures for reviewing 
food additives, color additives, and residues of animal 
drugs are more routine than those for evaluating food 
contaminants, whose occurrence is largely unpredictable. 

On receipt in the Division of Food and Color Additives, a 
food-additive petition is evaluated to determine whether 
it is acceptable for filing. This involves not only 
review of its formal adequacy, but a preliminary assess¬ 
ment of the toxicologic data to determine whether all 
potential health effects have been studied. 

After official filing of the petition, scientists from 
the appropriate divisions (ordinarily with the assistance 
of scientists outside the agency) study the supporting 
chemical, toxicologic, and exposure data to decide whether 
the compound is safe. The food-additive law has been 
construed as requiring, even when the Delaney clause is 
not applicable, "reasonable certainty" that no consumer 
will be harmed. No effort is made to evaluate the bene¬ 
fits that an additive might provide, but the Bureau must 
be satisfied that the additive achieves its intended 
effects. This exercise usually has two parts: first. 
Division of Toxicology scientists determine a no-observed- 
effect concentration for the additive on the basis of 
acute, subchronic, and chronic feeding studies in animals; 
second, applying a so-called safety factor, they determine 
a permissible extent of use in human food or an acceptable 
daily intake. This value is then compared with the esti¬ 
mated daily human exposure based on the manufacturer 1 s 
proposed use and predicted human consumption of the foods 
in which the additive is to be used. An acceptable expo¬ 
sure to an additive is one at which human exposure is at 
or below the acceptable daily intake. Under current law, 
this intake value cannot be established for a direct food 
or color additive that is carcinogenic; such a substance 
may not be approved for use. 

The risk assessment function is performed entirely by 
Bureau scientists. Bureau staff, including the reviewing 
scientists, may meet with representatives of the peti¬ 
tioner to discuss uncertainties, request additional data, 
or suggest reduced use. Typically, both the scientific 
and the regulatory aspects of food-additive petitions are 
reviewed and resolved at the division level in the Bureau 
of Foods. On petitions that raise difficult scientific 
and policy issues or that pose the question of carcinoge¬ 
nicity, the divisions generally seek advice or direction 
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from the associate directors. Bureau deputy directo 3, 
the Bureau Director. The Bureau may, in turn, seek ad 1 
from the Chief Counsel, from other bureaus, or from :h< 
Commissioner 1 s office during the review of petition tl 
present particular scientific, legal, or policy ques :ic 

Once the responsible unit is satisfied that an a< lil 
is approvable and thus that a regulation is appropri ti 
the Division of Food and Color Additives prepares a o< 
ment package consisting of an action memorandum, a c al 
federal Register document, and supporting material, h: 
is then forwarded through established review channel 1 
the Director’s office for final Bureau approval and r« 
mission to the Commissioner’s office. The action me di 
dum recommending approval by the Associate Commissio s: 
for Regulatory Affairs, to whom the Commissioner has !< 
gated formal approval authority, necessarily incorpo a 
both scientific assessments and regulatory judgments 
Because the governing legal standard focuses exclusi 3 
on the health effects of the additive, the approval j < 
cess is not influenced by consideration of economic < : 
other benefits. 

The sequence of analysis in the Bureau for enviroi ■ 
mental contaminants does not differ sharply from that 
described above for food additives, although differer 
divisions may participate in the process and economic 
factors are consciously considered. The statutory pr ■ 
vision under which FDA regulates food contaminants co I 
plates that it will balance the risk posed by a subst i 
against the effects of reducing consumer exposure, su 1 
as loss of food and increases in price. Accordingly, 
action memorandum sent to the Bureau Director recommei 
an exposure limit based on three criteria: an assess: 
of the risk posed by the contaminant, an evaluation oi 
available methods of chemical analysis to monitor its 
presence, and an estimate of the economic effects of 
alternative limits. 


Methods and Use of Guidelines 

Although the Bureau’s approach to the evaluation of ac 
toxicants has remained stable over a long period, its 
methods for evaluating potential carcinogens have unde 
gone substantial change since the early 1970s. In 197 
the Bureau Director formed a Cancer Assessment Committ< 
in the Office of Toxicological Sciences to evaluate th< 
carcinogenicity of substances being considered for 
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approval or regulation and to perform risk assessments. 

A list of substances reviewed by this Committee in 1981 
is given in Table III-3. The 12 members of the Committee 
are all PDA employees and include toxicologists, pathol¬ 
ogists, mathematicians, and chemists. The role of the 
Committee is to render all final decisions on carcino¬ 
genicity for the Bureau of Foods on the basis of scien¬ 
tific information available to it. Its primary function 
is to determine whether, on the basis of a fair evalua¬ 
tion of all available data, a chemical is a potential or 
actual carcinogen. Because the Delaney clause, which 
forbids exposure of any food or color additive that 
induces cancer, applies to many substances in the Bureau 1 s 
jurisdiction, quantitative (e.g., dose-response) assess¬ 
ments are not always performed. For some substances, such 
as contaminants, the magnitude of the risk is relevant, 
and scientists from the various divisions collaborate with 
staff responsible for gathering information on human expo¬ 
sure to perform risk characterizations. The Cancer 
Assessment Committee does not typically prepare formal 
written assessments, so there is no document available 
that outlines the relevant data and the rationale for the 
choices of options made in the assessment of risks. The 
Cancer Assessment Committee apparently does not follow 
comprehensive written guidelines, although it does follow 
some general guidelines that were used in previous deci¬ 
sions and are set out in the agency's drug-residue 
proposal. 


Peer Review 


In recent years, the Bureau of Foods has sought indepen¬ 
dent scientific review of the data on a number of sub¬ 
stances, Often Bureau staff informally solicit the judg¬ 
ments of individual outside scientists on major issues. 

The Bureau routinely uses outside panels established 
under the auspices of the Federation of American Societies 
for Experimental Biology for periodic review of substances 
now generally recognized as safe (GRAS)• Ad hoc panels 
were convened to evaluate the data on such substances as 
eye lama te, saccharin. Red No. 2, and Red No. 40. 

More recently, the Bureau has turned to a standing 
panel, the Board of Scientific Counselors of the National 
Toxicology Program. The Board's review of the data on 
color additive Green No. 5 illustrates the Bureau's 
approach to external peer review. The Board reviewed the 
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TABLE III-3 Substances Evaluated for Carcinogenici r by 
the FDA Cancer Assessment Committee in 1981 


Acrylonitrile 

1,2-Dichloroethane 

Lead acetate 

Diethylhexylphthalate 

Vinyl chloride 

Diethylhexyladipate 

Dioxane 

Furazolidone 

£-Toluidine 

Cinnamyl anthranilate 

Hydrazine 

Trimethylphosphate 


original data from a study done by a commercial labo a- 
tory, which were submitted with a petition for appro al 
of the substance• The Board also considered aspects )f 
the analysis done by Bureau staff and conducted an i le~ 
pendent evaluation of the pathology slides and a stai .s- 
tical analysis of the study results. Bureau scienti, :s 
asked that the Board reach a conclusion concerning tl ! 
strength of the evidence of carcinogenicity. Thus, i le 
Board was limited to scientific issues and did not cc r 
sider the possible social implications of its findinc 
After the Board 1 s finding that the evidence was incor 
elusive and before the Bureau's conclusion that the 
additive was unlikely to be a human carcinogen, Burea 
staff performed a risk characterization to estimate t e 
potential risks if this conclusion were in error. 

The decision to consult an outside panel for revie of 
risk assessments for potential carcinogens is made by -he 
Chairman of the Cancer Assessment Committee. The Bur au 
currently is considering establishing a standing comm 
tee that could be called on to review agency assessme :s. 
It is likely that the impetus to form a standing revi< / 
committee stems from criticisms of past agency practi< *s, 
especially those followed in the evaluation of the dal i 
on nitrite. In this instance, FDA's contemplated act: >n 
against nitrite in 1979 was announced before Bureau sc en- 
tists had had an opportunity to evaluate the critical 
toxicity data and to refer the data to an independent 
panel. This controversial chapter in FDA's history o 1 
regulating food ingredients has often been cited as 
demonstrating the need for systematic peer review of t e 
agency's risk analyses in order to avoid the problems 
that can arise when risk management considerations aff ct 
the conduct of risk assessments. The existence of a 
standing panel, although no guarantee, may discourage 
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agency officials from deviating from standard Bureau 
procedures that are now designed to ensure adequate peer 
review. 


EPA 8 S CARCINOGEN ASSESSMENT GROUP 

EPA 1 s Carcinogen Assessment Group (CAG) was created in 
1976 by the EPA Administrator to implement generic and 
uniform agency guidelines for carcinogenic risk assess¬ 
ment. Initially, it was a separate body in the Agency* s 
Office of Research and Development and reported directly 
to its Assistant Administrator. In 1979, however, the 
Office of Health and Environmental Assessment was estab¬ 
lished in the Office of Research and Development, and CAG 
became one of several assessment groups (Figure III-3) • 
Organizationally, CAG staff are separate from, and inde¬ 
pendent of, the risk management function; i.e., it is an 
example of intra-agency separation. It also serves as an 
example of an internally centralized assessment body, in 
that it performs assessments for several different regula¬ 
tory programs in EPA. 

Although CAG personnel do meet and talk with regula¬ 
tory program personnel and are customarily well aware of 
any programmatic interest in particular substances and of 
interest-group preferences, this office is insulated from 
the day-to-day pressures of program offices. Thus, the 
organizational arrangement that places CAG in the Office 
of Research and Development does have the initial effect 
of freeing risk assessment personnel from specific policy 
issues that arise when risk management options are consid¬ 
ered. However, when a scientific review committee exam¬ 
ines documents produced by this office later in the pro¬ 
cess, interest groups are able to express their views and 
CAG personnel are no longer isolated from such influences. 

Currently, all CAG assessments are done by in-house 
staff, although in the past some were done by consultants. 
Usually, contractors are employed only for the time- 
consuming and mechanical task of conducting literature 
searches. Responsibility for each assessment is assigned 
to a particular person, but other staff members contribute 
to various sections according to their particular special¬ 
ties and expertness. Its staff has been remarkably 
stable; since 1976, only one person has left the group. 

As of October 1982, 11 full-time professionals were on 
its staff, nine of whom had doctorates. Most staff mem¬ 
bers have an academic background, and their professional 
work experience averages 10 years. The staff includes 
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three biostatisticians, two biochemists, two epidemiolo¬ 
gists, one biophysicist, one pathologist, one pharmacolo¬ 
gist, and one endocrinologist. The former Director, now 
a consultant, is the only physician associated with the 
office. 


Agenda and Procedures 

CAG does not initiate its own assessments; instead, it 
responds to requests from regulatory (program) offices in 
EPA. It does, however, set its own priorities in consul¬ 
tation with the program offices, on the basis of the 
workload of requests and the urgency of the need for the 
assessments. Although it serves as a risk assessment 
body for the whole Agency, not all programs in EPA use 
CAG. The most notable exception is the Office of Toxic 
Substances. Apparently, one factor cited by program 
offices as leading to this lack of use is the length of 
time CAG requires to complete an assessment. 

Since 1976, CAG has prepared assessments for approxi- 
mately 150 chemicals. The length and scope of the docu¬ 
ments produced vary with the data available, with their 
purpose, and with the needs of the requesting office. 

They can range from brief and preliminary literature 
reviews relevant to hazard identification or tentative 
estimates of risk as a function of dose to complete and 
thorough literature reviews leading to a comprehensive 
risk characterization. In-depth evaluations may or may 
not include quantitative dose-response assessments. As 
an example of its work agenda, CAG has covered 41 chemi¬ 
cals for the Agency’s Office of Air Quality Planning and 
Standards. In-depth evaluations were performed for nine 
(see Table III-4), and preliminary assessments for 32. 


Methods and Use of Guidelines 


The risk assessments performed by this group are based on 
Agency guidelines developed initially by CAG in 1976 for 
use by the entire Agency. These guidelines have been 
revised after initial publication, and some of the changes 
have also been published (EPA, 1979, 1980)• Normally, 
individual assessment documents produced do not reexamine 
or indeed articulate underlying guidelines; rather, the 
reader is presumed to know that EPA and CAG rely on 
guidelines that embody particular choices among several 
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TABLE III-4 Substances Fully Evaluated by the C rcinogtt 
Assessment Group for the EPA Office of Air Quali y 
Planning and Standards 


Arsenic 

Benzene 

Vinyl chloride 
Aery Ion itr ile-S 
Coke-oven emission^ 


Methyl chloroform^ 
Methylene chloride^ 
TetrachloroethylenejS 
Trichloroethylene^ 


Sunder review as of October 1982 • 


inference options available• Also, the changes m le in 
the guidelines have not, in many cases, been form Lly 
acknowledged? i.e., the current guidelines do not sxist 
in a single publicly accessible written document* CUfi's 
use of guidelines, especially for hazard identific tiorii 
has been regarded by some EPA review panels—notal y, tl 
Subcommittee on Airborne Carcinogens—as too infle iblej 
possibly misleading, and interfering with criticaJ anal] 
sis of underlying data. In fact, the initial publ shed 
guidelines (EPA, 1976) did permit different inters eta- 
tions of data and the use of different risk assess ant 
methods; however, the methods embodied in CAG asse sraeni 
and those related to dose-response assessment and abo¬ 
lished in EPA's Water Quality Methodology for Care iogei 
do not reflect this flexibility* The misunderstan Lngs 
experienced with the Subcommittee on Airborne Care: loger 
(and other review bodies) have stemmed to a great < *gre< 
from the facts that CAG's guidelines are in flux, i mail 
unwritten, and are not presented in the individual 
assessment documents provided to the review coramitt es. 
As a result, reviewers are likely to be unaware of he 
operational ground rules used in interpreting card o~ 
genicity data and developing risk estimates. The a sene 
of an explicit discussion of the application of Age zy 
guidelines and of discussion of the rationale for t b 
choices made in a risk assessment blurs the distinc Lon 
between science and policy considerations in CAG 
assessments. 


Peer Review 


Drafts are reviewed by all members of the CAG staff and 
its Director* Drafts are also usually sent for review on 
an ad hoc basis to knowledgeable persons outside the 
agency. However, this review process is not part of the 
public record, and criticism may be accepted or rejected 
at CAG's discretion. The lack of adequate procedures to 
ensure that peer review comments are given proper consid¬ 
eration may lessen any benefits to be derived from peer 
review early in the process of developing a risk assess¬ 
ment. Draft risk assessments are usually reviewed by the 
Director of the Office of Health and Environmental Assess¬ 
ment, directors of other units in this office, and Office 
of Research and Development staff before being submitted 
to the requesting program office. CAG assessments are 
often submitted to committees of EPA's Science Advisory 
Board or to the Scientific Advisory Panel for peer review. 
Such reviews take place in public sessions, in accordance 
with the requirements of the Federal Advisory Committee 
Act. They provide an opportunity for interested members 
of the public to review CAG documents and to communicate 
criticisms to the reviewing committee and EPA. Reviews 
of CAG assessments by EPA panels have been mixed, with 
some panels, such as the Scientific Advisory Panel, often 
approving the assessments and others finding numerous 
shortcomings related to both substance and format (e.g., 
the Subcommittees on Arsenic as a Possible Hazardous Air 
Pollutant and on Airborne Carcinogens of the Agency's 
Science Advisory Board). This public review process 
usually leads to revisions. 


NIOSH-OSHA 


The Occupational Safety and Health Act of 1970 created 
two new organizations: OSHA and NIOSH. OSHA was a new 
component of the Department of Labor. NIOSH was placed 
in the Department of Health, Education, and Welfare, now 
the Department of Health and Human Services. Since 1973, 
NIOSH has been a part of the Centers for Disease Control 
in the U.S. Public Health Service. The common mission 
set for both agencies was the protection of the health of 
American workers. NIOSH's primary functions included the 
conduct of research and development of criteria for recom¬ 
mendations to OSHA for occupational health standards. In 
addition, the Act authorized NIOSH to "develop and estab- 
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lish recommended occupational safety and health ta 
dards." Although it is not technically correct o 
to NIOSH criteria documents simply as risk asses tie 
because the documents contain additional informs ic 
concerning risk management (e.g., engineering co 3 i 
t ions) as well as recommended standards, the doc ne 
normally included sections that dealt with the a re 
health effects of the substances being considere * 
health-effects sections would correspond to the < m 
mittee*s definition of hazard identification . 

The legislative history of the Act makes it c, \a 
Congress intended a close coupling between NIOSH \ 
mendations and OSHA’s standards. Nevertheless, ] 1 
few NIOSH criteria documents have led to OSHA st. id 
This disjunction between the two agencies has st< m 
the difficulty of coordinating two organizations 1 
physically separated and responsible to different 6 
ments. As mentioned earlier, the degree to whic] C 
has relied on NIOSH for its scientific expertise s 
varied. In the early 1970s, OSHA relied heavily i 
for evaluation of health effects; later, OSHA de\ ] 
its own staff of health scientists and, with coni c 
help from consultants and contractors, performed t 
risk assessments to support agency standard-setti c 
activities. 

Because OSHA conducts its own assessments of i i 
well as setting standards, and NIOSH does risk a ; 
ments and recommends standards, the relation of N 
OSHA as it has existed since 1976 represents, in 
sense, duplication, rather than true extra-agency 
tion. The earlier relation between the two agenc 
however, an example of extra-agency separation, 
tion focuses on NIOSH 1 s production of criteria do 
during both phases and reflects procedures used t 
out the 1970s. 


Agenda and Procedures 

In the past, NIOSH had an elaborate procedure for 
priorities, which included soliciting nominations 
didate substances from OSHA and the public. In p 
however, before 1976, NIOSH's criteria document ac 
was set by agency personnel and the Director, on i 
of their views of the seriousness of various occui 
hazards and the number of workers exposed to such 
OSHA played little or no role in the selection prc 
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and NIOSH 9 s agenda for documents therefore did not reflect 
or greatly influence OSHA 9 s regulatory agenda* One cause 
of this lack of correlation between the two schedules was 
their physical and organizational separation. In the late 
1970s, NIOSH did receive communications from OSHA that 
led NIOSH to begin production of process- and industry- 
oriented criteria documents. Table III-5 lists criteria 
documents transmitted to OSHA. 


Methods and Use of Guidelines 


Preparation of a criteria document involved a preliminary 
review of literature and the identification of gaps in 
the relevant knowledge. This gap analysis was fed into 
NIOSH*s research planning and led to research directed at 
filling the gaps. Brief studies could be completed in 
time for their results to be incorporated into the docu¬ 
ment. Others would continue after the document was com¬ 
pleted and sometimes resulted in revision or updating. 

The literature review and preparation of a draft document 
were commonly performed by an external contractor under 
the supervision of NIOSH personnel. Because NIOSH does 
not have written guidelines for risk assessment, whether 
personnel preparing the documents used similar approaches 
to evaluate data and reach conclusions regarding risks is 
unclear. NIOSH * s failure to develop risk assessment 
guidelines has helped to obscure the distinction between 
scientific and policy judgments in the risk assessment 
process. Although the rationale for separating NIOSH 
from OSHA has been to allow an independent scientific 
evaluation without the consideration of economic impli¬ 
cations that is necessary in OSHA rule-making activities, 
the effectiveness of this institutional separation in 
eliminating the effects of such risk management considera¬ 
tions on the conduct of risk assessment by NIOSH is 
difficult to determine. 


Peer Review 

The initial review of a draft criteria document was typi¬ 
cally performed by NIOSH staff in the same division of 
the agency that produced the document. The division 
draft was then submitted to other NIOSH divisions for 
review. This was followed by a review performed by 
knowledgeable experts from industry, labor organizations. 
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TABLE III-5 NIOSH Criteria Documents Sent 1 
OSHA by May 1982 


Substance or Subject Transmitted to OSHi 


Acetylene 1976 

Acrylamide 1976 

Acrylonitrile 1977 

Alkanes 1977 

Allyl chloride 1976 

Ammonia 1974 

Antimony 1978 

Arsenic, inorganic 1974, 1975 

Asbestos 1972, 1976 

Asphalt fumes 1977 

Benzene 1974, 1977 

Benzoyl peroxide 1977 

Benzyl chloride 1978 

Beryllium 1972, 1977 

Boron trifluoride 1976 

Cadmium 1976 

Carbaryl 1976 

Carbon black 1978 

Carbon dioxide 1976 

Carbon disulfide 1977 

Carbon monoxide 1972 

Carbon tetrachloride 1975, 1976 

Chlorine 1976 

Chloroform 1974, 1976 

Chlorophene 1977 

Chromic acid 1973 

Chromium (VI) 1975 

Coal-gasification plants 1978 

Coal-liquefaction (Vols. I and II) 1981 

Coal-tar products 1977 

Cobalt 1981 

Coke-oven emission 1973 

Confined spaces (as workplaces) 1980 

Cotton dust 1974 

Cresol 1978 

Cyanide, hydrogen, and cyanide salts 1976 

Decomposition products of fluorocarbon 1977 

Dibromochloropropane 1977 

Diisocyanates 1978 

Dinitro-o-cresol 1978 

Dioxane 1977 

Emergency egress from 1975 

elevated work stations 

Epichlorohydrin 1976 

Ethylene dibromide 1977 

Fibrous glass 1977 

Fluorides, inorganic 1975 

Formaldehyde 1976 

Furfuryl alcohol 1979 

Glycidyl ethers 1978 

Hot environments 1972 

Hydrazines 1978 
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TABLE III-5 (Continued) 


Substance or Subject Transmitted to 

OSHA 

Hydrogen fluoride 

1976 


Hydrogen sulfide 

1977 


Hydroquinone 

1978 


Identification system for 

1974 


occupationally hazardous materials 

Isopropyl alcohol 

1976 


Kepones 

1976 


Ketones 

1978 


Lead, inorganic 

1973, 

1977 

Logging—from felling to first haul 

1976 


Malathion 

1976 


Mercury, inorganic 

1973 


Methyl alcohol 

1976 


Methylene chloride 

1976 


Methyl parathion 

1976 


Nickel, inorganic and compounds 

1977 


Nitric acid 

1976 


Nitriles 

1978 


Nitrogen oxides 

1976 


Nitroglycerin—ethylene 

1978 


glycol dinitrate 

Noise 

1972 


Organotin compounds 

1976 


Parathion 

1976 


Pesticide manufacturing and 

1978 


formulation 

Phenol 

1976 


Phosgene 

1976 


Polychlorinated biphenyls 

1977 


Refined petroleum solvent 

1977 


Silica, crystalline 

1974 


Sodium hydroxide 

1975 


Sulfur dioxide 

1974, 

1977 

Sulfuric acid 

1974 


1,1,2,2-Tetrachloroethane 

1976 


Tetrachloroethylene 

1976 


Thiols: n-alkane mono-, 

1978 


cyclohexane, and benzene 

Toluene 

1973 


Toluene diisocyanate 

1973, 

1978 

o-Toluidine 

1978 


1,1,1-Trichloroethane 

1976 


Tungsten and cemented tungsten carbide 

1977 


Ultraviolet radiation 

1972 


Vanadium 

1977 


Vinyl acetate 

1978 


Vinyl chloride 

1974 


Vinyl halides 

1978 


Waste anesthetic gases and vapors 

1977 


Xylene 

1975 


Zinc oxide 

1975 
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and universities. In addition, other appropriate 
ment agencies, professional associations, and trad 
organizations were invited to review the document, 
these various reviews were complete and changes we: 
as deemed appropriate by division staff, the doc urn 
forwarded to the Director of NIOSH. 

Several shortcomings of NIOSH criteria document 
cited in a recent review of the program funded by i 
agency: the lack of field experience of criteria d< 
managers, the lack of critical analysis of data, ai 
alleged disregard of reviewers* comments. The lat 
claim highlights the importance of procedures that 
that reviewers* comments are adequately addressed, 
lack of critical analysis of data has been attribul 
least in part to the facts that the documents were 
developed by outside contractors and that NIOSH hac 
control over the personnel assigned to the contrac 


COMMITTEES OF THE NATIONAL RESEARCH COUNCIL 

The National Research Council (NRC) is the operatir 
for the National Academy of Sciences* advisory func 
As part of this advisory function, NRC has been ca] 
by a number of regulatory agencies to perform risk 
ments. Regulatory agencies request assessments by 
several reasons, including statutory requirements t 
particular agencies or programs consult with NRC, i 
quacy of agency staff to perform the assessments (c 
the case of the FDA request for a review of pre-196 
prescription drugs), and such political objectives 
desire for outside scientific support of an anticip 
agency action or a desire to defuse or postpone cor 
versy. Agencies remain free to accept or reject th 
analyses and conclusions included in NRC reports, 
risk assessment reports are usually not sufficient 
themselves to dictate specific regulatory action, a 
separate assessment is usually conducted by the age 
even if in only the most perfunctory fashion. 

NRC has done risk assessments for several agenci 
with jurisdiction over carcinogenic chemicals. Ho* 
NRC is in no real sense a centralized risk assessme 
body and is a very imperfect model for recent propc 
to create such a body. First, most of the evaluati 
work of the NRC is actually performed by individual 
committees created on an ad hoc basis for each stud 
Thus, NRC is not a single risk assessment body, but 
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rather an umbrella for the work of many diverse, if out¬ 
wardly similar, committees. Second, each ad hoc committee 
generally reports to a single agency and does not perform 
assessments for several bodies at once. The committees 
of NRC have been included in our survey as examples of ad 
hoc risk assessment groups that are entirely separate from 
government regulators. Table III-6 is a partial list of 
NRC reports (published since 1977) that examined the car¬ 
cinogenic risks associated with exposure to particular 
chemicals. 


Agenda and Procedures 

Committee members are appointed on the strength of their 
professional qualifications; they may come from univer¬ 
sities, industry, government, or another sector of soci- 
ety, but they do not serve as representatives of any 
agency, group, or institution unless they are specifi¬ 
cally so designated on appointment. Occasionally when, 
by virtue of special expertise or for other reasons, per¬ 
sons affiliated with interested parties are placed on 
committees, every effort is made to achieve a balance of 
interests. In any case, all committee members are asked 
to complete a statement, "On Potential Sources of Bias," 
which includes information on sources of personal income, 
sources of research support, and more subtle forms of 
personal bias, including values held that may influence a 
member's judgment. The membership of every committee that 
will formulate a position, take an action, or prepare a 
report is reviewed by NRC staff and must be approved by 
the Chairman of NRC. The work of the committees is facil¬ 
itated by professional and support staff employed by NRC. 

The conduct of a study varies with its nature and 
objective, the time permitted to complete it, its politi¬ 
cal sensitivity, and the personalities involved. In gen¬ 
eral, committees have considerable latitude in carrying 
out their responsibilities and may hold public meetings 
and schedule technical conferences to collect pertinent 
information. Committees typically meet three to six 
times a year. Meetings are concerned with planning, 
discussions of issues and drafts of reports, and, later, 
the development of final conclusions and recommendations. 
Although a committee has much freedom in planning and 
executing its study and reaching its conclusions, several 
restrictions include the obvious necessity to respond to 
the charge stipulated in the contract, time and budgetary 
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TABLE III-6 Some NRC Reports Dealing with 
Carcinogenic Chemicals (1977-1982) 


Report 


Parent 

UnitS Ye 


An Assessment of Mercury CPSMR 

in the Environment 

An Evaluation of the Carcino- CLS 

genicity of Chlordane and 
Heptachlor 

Dr inking Water and Health CLS 

Arsenic CLS 

Nitrates CPSMR 

Saccharin—Technical Assess- CLS 

ment of Risks and Benefits 
Polychlorinated Biphenyls CPSMR 

Drinking Water and Health, Vol. Ill CLS 

The Alkyl Benzenes CLS 

Formaldehyde—An Assessment CLS 

of Its Health Effects 

Regulating Pesticides CPSMR 

Aromatic Amines: An Assess- CLS 

ment of the Biological and 
Environmental Effects 

Formaldehyde and Other Aldehydes CLS 

The Health Effects of Nitrate, CLS 

Nitrite, and N-Nitroso Compounds 
Indoor Pollutants CLS 

Selected Aliphatic Amines CLS 

and Related Compounds: An 
Assessment of the Biological 
and Environmental Effects 
Alternatives to the Current CLS 

Use of Nitrite in Foods 
An Assessment of the Health CLS 

Risks of Seven Pesticides 
for Termite Control 

Diet, Nutrition, and Cancer CLS 

Drinking Water and Health, Vol. IV CLS 

Quality Criteria for Water Reuse CLS 

Possible Long-Term Health CLS 

Effects of Short-Term 
Exposure to Chemical Agents, 

Vol. 1—Anticholinesterases 
and Anticholinergics 


IS 


IS 


1 < 

IS 

1 ! 

IS 

1 ! 

IS 

1 ! 

LS 


V 


3 


^CPSMR = Commission on Physical Sciences, Mathematics 
and Resources; CLS « Commission on Life Sciences. 
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limitations*, and the necessity for a central NRC-monitored 

review of the final report. 

In addition to providing scientific analyses on which 

policy or regulatory decisions can be based, NRC reports 
sometimes make specific recommendations for changes in 
government policy. 


Methods and Use of Guidelines 


NRC risk assessments are not easily classified or charac¬ 
terized. Because different committees prepare risk- 
related reports and NRC does not have any guidelines on 
the conduct of risk assessments for the committees to 
follow, approaches and final products show pronounced 
variations. The absence of guidelines, coupled with the 
occasional practice of not including a clear explanation 
of how conclusions concerning risk were reached or of the 
assumptions used in the quantitation of risk, has led to 
a blurring of the distinction between scientific and 
policy judgments made in the assessment of risks. The 
lack of guidelines has also led to inconsistencies in 
approach and final decisions among committees. However, 
the absence of specific guidance for interpreting data 
and for choosing methods of dose-response assessment or 
risk characterization is probably to be expected, inasmuch 
as NRC committees consist of scientific experts whose 
independent judgments are being sought. Probably only 
guidelines that are extremely flexible could be adopted 
by NRC. A subject of much discussion over the last sev¬ 
eral years has been the value of including quantitative 
assessments (in our terms, dose-response assessments or, 
if exposure data are incorporated, risk characterizations) 
in reports. The trend in recent years has been to include 
some form of a quantitative risk estimate. 


Peer Review 


Every report from the NRC is reviewed by a group other 
than the authors. The process of reviewing is overseen 
by the Report Review Committee. The reports likely to 
receive reviews coordinated by that Committee are those 
j udged to have significant policy implications and likely 
to be controversial; most reports that address risk- 
related questions would be in this category. (The Report 
Review Committee also coordinates the review of noncontro- 
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versial reports on an ad hoc basis to monitor the >verall- 
quality of NRC reports.) A report not receiving ach a 
review is reviewed under the auspices of its parei : com¬ 
mission, independent office, or board. Report Re Lew 
Committee review entails submission of a draft rej >rt to 
a set of reviewers selected in a cooperative proc< ;s by 
the the parent body and the Report Review Committe . 

These reviewers are invited to comment on technics . 
adequacy and accuracy (the expert ness of the authc s), on 
clarity and appropriateness of presentation, on re ponse 
to charge, on cogency of recommendations with resp ct to 
data presented, and on degree of objectivity and i eedom 
from bias. The committee and staff respond to re^j ewers' 
criticisms and suggestions, and the responses are xam- 
ined by a monitor, usually a member of the Report aview 
Committee, to determine their appropriateness. Tli s, a 
person outside the unit that prepared the report d 3 ides 
whether adequate consideration has been given to r - 
viewers* comments. In cases of persistent and sev re 
disagreement between reviewers and authors, the ma ter 
may be referred to the NRC chairman for resolution 

Like the regulatory agencies, NRC has been the abject 
of controversy in recent years. Some NRC committe< 5 have 
been accused of bias related to their judgments on :he 
risks associated with the substances they are stud; .ng. 
The absence of a member from a discipline that is npor- 
tant for a balanced assessment of risk can also we< :en 
the credibility of an NRC report. For example, an .nter- 
nal NRC study (1981) stated that, in a small sample of 
risk-related studies completed before 1979, such d sci- 
plines as epidemiology were often not represented c . the 
rosters of committees whose subjects appeared to w« rant 
such knowledge• 


FD.VS DRUG EVALUATION PANELS 


Under the Federal Food, Drug, and Cosmetic Act, FDP 
regulates the marketing of all medicines for human 
use—prescription pharmaceuticals, over-the-counter 
drugs, and biologic products, which are also subjec to 
the 1902 Biologics Act. In its efforts to ensure t e 
safety and effectiveness of drugs in these three cl 3ses, 
FDA has relied heavily on advisory panels composed 
primarily of scientists from academic medicine. Tw 
major programs illustrate the important role of sue 
independent expert panels in agency assessments of iman 
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drugs: the Drug Efficacy Study, a review of the effec¬ 
tiveness of pre-1962 prescription drugs undertaken by NRC 
in 1966i and the over-the-counter Drug Review, in which 

advisory panels established directly by FDA have evaluated 
the effectiveness and safety of ingredients of such drugs. 

Both the NRC review and the FDA-directed review enabled 
FDA to undertake systematic studies of product performance 
that would have overwhelmed the agency's own resources 
and personnel. The two reviews differed in a number of 
respects that may shed some light on optimal structures 
and procedures for scientific panels. 


NRC Review 

The 1962 Kefauver-Harris Amendments to the Federal Food, 
Drug, and Cosmetic Act required that all new drugs be 
proved effective, as well as safe, and obliged FDA, after 
a 2-year grace period, to require proof of efficacy of 
all pre-1962 drugs. In discharging this obligation for 
prescription drugs, the agency turned to NRC to establish 
some 30 panels of six to eight experts in pharmaceutical 
therapy? each panel was responsible for a class of drugs. 

The panels evaluated the data supplied to them by FDA 
and manufacturers and rated the drugs as effective, prob¬ 
ably effective, possibly effective, ineffective, ineffec¬ 
tive as a fixed combination, or inferior to other better 
or safer therapies for the same indications. Their main 
function was thus to assess therapeutic efficacy, not risk 
to patient health (except indirectly)? all the drugs 
reviewed had been judged to be safe before original FDA 
approval. Nevertheless, the panels included comments on 
the safety of individual drugs, particularly those whose 
effectiveness was in doubt. An informal NRC coordinating 
group attempted to review each panel's ratings before for¬ 
warding them to FDA, in the hope of ensuring some consis¬ 
tency. In practice, however, the panel's verdicts reached 
FDA largely unreviewed. 

The clinical and other data on which the panels relied 
came from FDA files, the medical and scientific litera¬ 
ture, and the manufacturers of the drugs. The panels 
neither performed nor ordered any new research, although 
their assessments often identified subjects on which 
further studies were needed. The panels met and worked 
privately; apart from being invited to submit supporting 
data, manufacturers had no opportunity to participate in 
the panels' deliberations, nor did representatives of 
consumers or FDA staff. 
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To reconstruct precisely how the panels worke< or to 
determine what criteria for evaluation each folL red is 
difficult. The predetermined categories in whicl they 
were to rate drugs produced apparent homogeneity n their 
results, but did not sharply confine or direct tl ir 
analyses. Evidently, wide variations occurred ai ng the 
panels. The panels* assessments were reported tc PDA 
largely as statements of conclusions; many of the reports 
were only one or two paragraphs long. Explanatic s for 
the ratings typically took the form of bare refei nces to 
published studies or invocations of the informed adgment 
of the panelists. In short, the panels provided erdicts 
rather than documented evaluations. 

The weight to be given the panels* assessments ms not 
squarely addressed when FDA contracted for NRC as [stance 
Apparently, it was understood that FDA remained f *e to 
accept or reject a panel*s judgment, but it must ive 
expected to accept most of the panels* assessment when 
it contracted with NRC. The agency*s primary goa was to 
spare its own scientific staff the enormous burde of 
evaluating the effectiveness of thousands of pre- 62 
drugs. In practice, FDA has accorded substantial weight 
to the assessments provided by the NRC panels, usi .lly 
accepting the rating provided and initiating appr< >riate 
regulatory action. A rating of less than "effect: e" led 
to notification of a drug manufacturer that more < ita 
were needed to support a claim of effectiveness; J ter 
(often years later), if data were still considerec inade¬ 
quate, the agency took steps to remove the drug fi m the 
market. Some of the agency's efforts provoked pre racted 
litigation and administrative hearings. However, harma- 
ceutical manufacturers have acceded to the panels 1 judg¬ 
ments in the majority of instances, occasionally fc 
withdrawing products from the market, more frequer ly by 
eliminating claims for which supporting evidence w s 
lacking, and sometimes by sponsoring new clinical e- 
search. One important determinant of the acceptan 2 of 
panel assessments was the commercial importance of the 
product or claim at issue. When a panel rating an 
ultimate FDA judgment jeopardized the continued ma ceting 
of an important product, the manufacturer often in Lsted 
on its full legal rights in the course of combat in FDA's 
efforts at implementation. 
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FDA-Directed Drug Panels 

The NRC review of pre-1962 drugs did not address the mar¬ 
keting status of most over-the-counter drugs® In 1972, 

FDA launched a second comprehensive review, this time on 
both the effectiveness and the safety of all active ingre¬ 
dients in over-the-counter drugs. At the outset of this 
review, FDA chartered 17 advisory committees representing 
therapeutic groupings. These 17 panels met a total of 522 
times over a 9-year period; they reviewed 722 active 
ingredients for over 1,400 indications and submitted over 
75 reports on different therapeutic categories, e.g., 
internal analgesics, antimicrobials, and vaginal 
contraceptives. 

The central function of these review panels was to 
report and explain their assessments of the safety and 
effectiveness of the ingredients used in over-the-counter 
drugs. These reports were to set forth not only the 
panels 9 judgments rating each ingredient (as generally 
recognized as safe and effective, as unsafe or ineffec¬ 
tive, or as requiring additional study), but also sup¬ 
porting documentation and rationale. The panel reports 
became treatises on the various therapeutic categories, 
some well over 1,000 pages long. The recommendation 
segments of the reports were considerably shorter. 

FDA intended from the outset to rely heavily on the 
panels 9 assessments and thus insisted that they produce 
thoroughly documented findings. In addition, the panels 
were required to meet in public and to adhere to other 
requirements of the Federal Advisory Committee Act. 
Together, these obligations prolonged the panels 9 delib¬ 
erations. Although the Antacid Panel completed its report 
in less than a year, more complex categories, containing 
more ingredients, occupied panels for several years, 
during which they may have met once a month. 

The responsibility of producing a fully documented 
report required the panels to rely on FDA staff to 
assemble information, handle administrative and steno¬ 
graphic responsibilities, and often do much of the 
drafting. Thus, the sharp separation that existed 
between FDA*s Bureau of Drugs and the NRC panels never 
characterized its relation with the over-the-counter 
panels. However, because discussions of draft reports 
were held in public meetings and panel members reached 
their judgments in these meetings, the fact that the 
final text and judgments represented their views, rather 
than those of agency staff, was clear. The assessments 
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of the panels generally have commanded considerable Lccep- 
tance, because they were reached through public debc e 
and were thoroughly documented. 

At the outset of the review, FDA forecast that it would 
implement most of the panels® assessments. The ager y 
has released the panels® recommendations in the forir of 
notices of proposed rule-making, which are published in 
the Federal Register as the first step in translatin 
them into regulations. The Bureau of Drugs has expi ssly 
reserved the privilege of disagreeing with a panel's find¬ 
ings either immediately or in a tentative final monc raph, 
and it has sometimes done so. These occasions have een 
few, but usually controversial? and sometimes the Br eau 
has retreated from its initial disagreement. No man fac- 
turer has been successful in overturning, administra ively 
or in court, a panel judgment in which the Bureau of 
Drugs concurred. 

Perhaps an even better measure of the credence gi en 
the panels® assessments is the high degree of volunt ry 
compliance displayed by manufacturers. They have afc n- 
doned, albeit often reluctantly, most of the ingredi nts 
whose effectiveness the panels have doubted. Almost 
without exception, they have acceded to the panels' 
safety judgments. Similarly, they have generally ac epted 
the panels' recommendations for changes in labeling. 

This remarkable commercial deference to scientific j dg- 
ment has several explanations, in addition to the cr di~ 
bility of the panels. The slow pace of the review £ r- 
mitted manufacturers to make changes in their formul s or 
labeling without serious market disruption. The prc e- 
dures of the panels themselves afforded opportunitie for 
manufacturers to submit information and make argumer s 
before a judgment was rendered. Perhaps as importan , 
the panels' assessments, thus far, have not often jc par- 
dized the continued marketing of major products or w ole 
classes of drugs. If that occurs, it is likely that the 
panels' findings will encounter more determined 
opposition. 


NATIONAL TOXICOLOGY PROGRAM PANEL ON FORMALDEHYDE 

The National Toxicology Program (NTP) was establish^ in 
1978 by the Secretary of the Department of Health an 
Human Services to coordinate all toxicity testing of 
chemicals in the Department and to facilitate commun ca¬ 
tion between the research and regulatory agencies. ‘TP 
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embraces the relevant toxicity testing activities of the 
National Cancer Institute, National Institute of Environ¬ 
mental Health Sciences, FDA (and its National Center for 
Toxicological Research), and the Centers for Disease 
Control. OSHA, EPA, and CP SC also participate in NTP. A 
major advisory group for NTP is its Executive Committee, 
which is made up of the heads of the agencies listed 
above, as well as the Director of the National Institutes 
of Health and the Assistant Secretary for Health. NTP 
thus serves as a vehicle for cooperation among the four 
regulatory agencies—FDA, EPA, OSHA, and CPSC—especially 
in recommending candidate substances for testing. At 
least one agency has also called on NTP to review risk 
assessments: the FDA has on two occasions asked another 
NTP advisory group—the Board of Scientific Counselors— 
to review the carcinogenicity data and the agency* s analy¬ 
sis of those data on two color additives being considered 
for agency approval. In addition, NTP has served on one 
occasion as a structure through which a risk assessment 
of interest to all four regulatory agencies was performed. 

In April 1980, CPSC (in cooperation with the Inter¬ 
agency Regulatory Liaison Group) requested that the NTP 
help to form an interagency panel on formaldehyde to 
review the carcinogenicity data on this chemical. The 
Panel consisted of 16 government scientists, most of whom 
were experts in toxicology, pharmacology, and epidemi¬ 
ology. Three of the IRLG agencies—EPA, FDA, and OSHA— 
also supplied scientists as members. Although no employee 
of CPSC was an official Panel member, a liaison represen¬ 
tative of the agency attended all meetings and contributed 
to portions of the final report. In addition, CPSC per¬ 
sonnel assisted the Panel by preparing bibliographies and 
handling arrangements. 

The Panel on Formaldehyde thus serves as an example of 
a centralized assessment body that, although placed 
outside the agencies, maintained some association with 
the scientific staffs of each. The decision to confine 
the membership to government scientists was driven, in 
part, by a desire to avoid delays associated with com¬ 
pliance with the Federal Advisory Committee Act* s require¬ 
ments for establishing outside committees. The Panel* s 
creation was viewed as an experiment in interagency 
coordination. 

The Panel met three times. It generally deliberated 
in private, and its meetings were not announced. The 
Panel did consult with Chemical Industry Institute of 
Toxicology scientists who were responsible for designing 
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and conducting the carcinogenicity study being evaluated 
and it permitted both oral and written statements from 
the Formaldehyde Institute, a trade association of users 
and manufacturers. Although the Panel reported its find 
ings somewhat later than initially forecast by CPSC, the 
time required was a relatively brief 6-7 months. One 
unanticipated delay resulted from the necessity for a 
second review of the pathology slides from the major 
study being evaluated. The report stated that evaluatio 
of the findings on carcinogenic effect and other related 
data convinced the Panel members that formaldehyde is an 
animal carcinogen when inhaled. This finding has been 
supported by many other scientists, and the Panel's repo t 
has since been published in a peer-reviewed scientific 
journal. The Panel also concluded that none of the avai - 
able epidemiologic studies negated the inference that 
formaldehyde posed a cancer risk for humans. It did not 
attempt to estimate the risk of cancer for any exposed 
segment of the population. It did include, however, a 
quantitative dose-response assessment. 

The NTP Panel's formation and performance demonstrate 
that such ad hoc collaboration is manageable and can 
function well. Despite the quality of its report and it 
timely production, however, the NTP Panel's deliberation 
and report have not yielded any regulatory efficiencies. 

In early 1982, CPSC banned further use of urea-formal¬ 
dehyde foam insulation, in part on the basis of the 
Panel's report, as well as the agency's own risk assess¬ 
ments of formaldehyde's acute and chronic effects. In 
contrast, EPA has declined to initiate regulation of 
formaldehyde in response to the Panel's assessment. The 
Agency declined to act under Section 4 (f) of the Toxic 
Substances Control Act, noting that the animal data avai‘ ~ 
able on carcinogenicity did not constitute a "reasonable 
basis to conclude that [formaldehyde] presents or will 
present a significant risk of serious or widespread harm 
to human beings from cancer. ..." However, because th( 
Agency's posture is equivocal and not clearly documented, 
the degree to which it relied on the Panel's assessment 
in reaching the conclusion is unclear. 

Neither of the other two agencies followed CPSC's 
lead. OSHA declined to issue an emergency standard for 
worker exposure to formaldehyde, concluding that it poses 
no imminent hazard? and it recently announced that it was 
unable to proceed to establish a permanent standard, 
because the evidence of animal carcinogenicity did not 
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reveal what, if any, risk exposed workers might confront. 
These decisions were also based on OSHA's own assessment 
of risks, but the degree to which OSHA relied on the 
Panel's assessment for the agency's hazard identification 
step is unclear. Both EPA and OSHA are continuing to 
collect data on formaldehyde, but no regulatory action 
appears likely in the near future. FDA has not acted, 
because the potential formaldehyde exposures from agency- 
regulated products were judged to be very low. 

The contrasting regulatory outcomes should not be 
interpreted as indicative that the Panel on Formaldehyde 
failed in its mission. Although the four agencies planned 
to consider its report carefully, the Panel's findings 
were not expected to be binding. Each agency remained 
free not only to fashion its own regulatory response on 
formaldehyde, but to qualify, or to dissent from, the 
Panel's determination of carcinogenicity and estimate of 
risk. Factors other than the Panel report's validity and 
utility are more likely explanations for the divergent 
agency responses. First, the Panel's report was sub¬ 
mitted shortly before the 1980 national election, whose 
outcome forecast fundamental shifts in regulatory policy 
at EPA and OSHA. Second, the agencies confront exposures 
to formaldehyde that differ widely in character and inten¬ 
sity, yielding important differences in potential risk. 
Finally, the statutory criteria governing their decisions 
could plausibly lead them to accord different weights to 
the Panel's findings. OSHA, for example, had to decide 
whether formaldehyde posed a risk sufficient to justify 
emergency protective measures despite any costs of 
immediate action. 


EPA'S USE OF SCIENTIFIC REVIEW PANELS 

The EPA has had considerable experience with independent 
scientific panels, but they have served the Agency differ¬ 
ently from the risk assessment panels discussed in the 
preceding section. EPA's panels typically have reviewed 
the work of Agency scientists and analysts, rather than 
perform their own risk assessments. Also, most panels 
serving EPA are mandated by Congress and play legally 
prescribed roles in the Agency's decision-making process. 
We examined two such panels: EPA* s Scientific Advisory 
Panel and the Subcommittee on Airborne Carcinogens (a 
unit of EPA's Science Advisory Board)• 
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EPA's Scientific Advisory Panel (SAP) 

The Scientific Advisory Panel was established by Congre i 3 
in the 1975 Federal Insecticide, Fungicide, and Rodenti* 
cide Act to review EPA s s evaluations of the environment* L 
and health risks posed by specific pesticide uses. Bro li¬ 
ly speaking, the Panel reviews risk assessments prepare* 
by EPA® s Office of Pesticide Programs to support contem¬ 
plated regulatory actions against hazardous pesticides. 

It also reviews the proposed and final forms of such 
actions. Consultation was initially required only when 
the Agency contemplated suspending or canceling a pesti¬ 
cide's registration or issuing general regulations 
governing pesticide registration. Cancellations and 
general pesticide regulations must be submitted to the 
Panel for review before they take effect. Suspensions < : 
registration do not require prior review, but EPA must 
submit the underlying studies for review promptly after 
any suspension action. EPA must also submit for peer 
review the "design, protocols, and conduct of major sci< i- 
tific studies" conducted under the pesticide act. The 
following description reflects activities undertaken 
before September 1981.* 

The Panel normally consists of seven members selecte< 
by the EPA Administrator from among six persons nominate i 
by the National Institutes of Health and six nominated 1 r 
the National Science Foundation. Until its last meetinc 
in June 1981, the Panel generally met once a month. 

Topics covered during 1980 and 1981 are shown in Table 
111-7. The Panel does not set its own agenda, although 
the chairman may control the sequence and conduct of inc l- 
vidual sessions. The risk assessments that the Panel 
reviews are selected by the two divisions (Hazard Evalu* • 
tion and Special Pesticide Review) of the Office of 
Pesticide Programs that use its recommendations. Virtu¬ 
ally all the scientific and exposure information avail¬ 
able to the Panel is provided by the division whose 
assessment is being reviewed, although much of this 
information comes originally from the registrant of the 
product in question. Panel members necessarily accept 
the authenticity of the information provided, although 
they sometimes question its quality. 


♦Authorizing legislation expired in September 1981, and 
new legislation has not been enacted (as of December 
1982) . 
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TABLE III-7 EPA Actions Reviewed by the Scientific 
Advisory Panel (1980-1981) 


A. Regulations under Section 25(a) of The Federal 

Insecticide, Fungicide/ and Rodenticide Act 

1. Final Rulemaking for Registering Pesticides in the 
United States, Subpart E, Hazard Evaluation: 
Wildlife and Aquatic Organisms 

2. Proposed Rulemaking for Registering Pesticides in 
the United States, Subpart L, Hazard Evaluation: 
Nontarget Insects 

3. Proposed and Final Rulemaking for Registering 
Pesticides in the United States, Subpart D, 
Chemistry Requirements: Product Chemistry 

4. Final Rulemaking for Amendment of 40 CFR 162.31 by 
Adding Certain Uses of Eight Active Ingredients as 
Restricted Pesticides 

5. Proposed Rulemaking for Registering Pesticides in 
the United States, Subpart M, Data Requirements 
for Biorational Pesticides 

6. Final Rulemaking for Registering Pesticides in the 
United States, Subpart N, Chemistry Requirements: 
Environmental Fate 

7. Informal Review of Draft Proposed Pesticide 
Registration Guidelines, Subpart K, Exposure Data 
Requirements: Reentry Protection 

8. Review of Proposed Pesticide Registration 
Guidelines, Subpart H, Labeling of Pesticide 
Products 

9. Review of Final Rule on Classification of 11 
Active Ingredients for Restricted Use 

B. Cancellations under Section 6(b) of the Federal 

Insecticide, Fungicide, and Rodent icide Act 

1. Dimethoate 

2. Diallate 

3. Lindane 

4• Strychnine 

5. Ethylene dibromide 

6. Oxyfluorfen (Goal 2E) 

7. Wood preservatives, pentachlorophenol, creosote, 
arsenicals 
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Meetings are open to the public, and interested parti s 

are generally encouraged to make presentations. These 
meetings sometimes focus on risk management issues, rath r 
than on the health and environmental assessments submitt d 
to the Panel, in part because participants making presen 
tat ions are not confined to addressing scientific aspect 
of the Agency's risk assessments. Equally important in 
the consideration of nonscientific issues has been Con¬ 
gress's decision not to restrict the Panel to a strictly 
scientific review of the Agency's risk assessments. (Th 
Panel's mandated review responsibilities extend to conte - 
plated EPA actions that combine both risk assessment and 
regulatory policy elements.) Although the rationale for 
the Panel's creation was to introduce independent scien¬ 
tific review into EPA's deliberations, the mechanism 
chosen has routinely resulted in the Panel's commenting 
on the Agency's choice of regulatory options. The Agenc 
has sought to anticipate the Panel's tendency to stray 
from the scientific issues before it and has attempted t 
frame specific questions on which comments are requested 
The participation of the Panel probably has improved 
the quality of EPA analyses and added to their credibili y 
among both environmental and industry groups. However, 
expectations of some EPA critics that it would repudiate 
the Agency's scientific analyses have not been realized. 
Over the last 5 years, the Panel has agreed with most 
Agency risk assessments brought before it. There have 
been some notable exceptions, such as the Panel's dis¬ 
agreement with the Agency's handling of 2,4,5-T. The 
endorsement of most Agency assessments and Agency action 
based on those assessments by the Panel have been ex¬ 
tremely helpful in improving Agency credibility and 
rendered its actions less vulnerable to challenge in 
administrative or judicial hearings, as with the Panel's 
support of EPA action on wood preservatives. The Panel' i 
success can be traced to several causes: its public 
deliberations, which may have made it difficult for EPA 
to ignore its comments; its continuity (until its author¬ 
izing legislation expired), which permitted it to under¬ 
stand EPA's approaches and simultaneously strengthened 
its influence with EPA staff; and the scientific distinc¬ 
tion of individual Panel members. 

In the case of EPA's decision to suspend use of 
2,4,5-T and Silvex (its companion product) for some 
applications and to hold wide-ranging hearings on other 
applications, the Panel declined, after 3 days of public 
meetings, to support the Agency's proposed proceedings. 
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The Panel believed that additional data, including results 
of further tests for careinogenicity and reproductive tox¬ 
icity and of more complete monitoring for residues, were 
required before a hearing could be held profitably. 

Because EPA had not asked the Panel to approve the hold¬ 
ing of a hearing and believed that it would be more 
efficient to deal with all uses of 2,4,5-T at one time, 
the Agency persisted and announced a hearing on the risks 
and benefits of 2,4,5-T, which began in March 1980. This 
difference, coupled with congressional displeasure with 
EPA's original suspension of 2,4,5-T and Silvex, led ulti¬ 
mately to the 1980 statutory amendment mandating that the 
Scientific Advisory Panel review the studies that underlie 
suspension decisions. 


EPA 1 s Subcommittee on Airborne Carcinogens 

The Subcommittee on Airborne Carcinogens, a part of EPA f s 
Science Advisory Board, was not mandated by statute. It 
was created in 1980 at the request of the Assistant 
Administrator for Air, Noise, and Radiation to review the 
assessments that the Agency is statutorily required to 
submit for Board review. Members of this Subcommittee 
were appointed by the Administrator? however, it no longer 
exists, having recently been merged with the Environ¬ 
mental Health Committee of the Science Advisory Board. 

The Subcommittee reviewed six pairs of draft documents 
that included hazard identification and dose-response 
assessments produced by the Carcinogen Assessment Group 
and exposure assessments produced by private contractors 
for EPA*s Office of Air Quality Planning and Standards. 

The chemicals evaluated in those documents were trichloro¬ 
ethylene, perchloroethylene, methylene chloride, methyl 
chloroform, acrylonitrile, and toluene. Subcommittee 
members reviewing these documents included a biochemist, 
a biostatistician, a pathologist, an engineer, an oncolo¬ 
gist, a toxicologist, and a meteorologist. Five members 
were affiliated with universities and one with a research 
consulting organization; the seventh was a private con¬ 
sultant. 

In accordance with the Federal Advisory Committee Act, 
the Subcommittee's review was held in public and announced 
in the Federal Register , and interested members of the 
public were invited to make oral and written presenta¬ 
tions. Several such presentations were made, primarily 
by representatives of industries that would be affected 
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by EPA regulation of the substances under discussion. 
EPA and contractor personnel also attended the review 
participated actively# briefing the Subcommittee on th 
contents of documents# answering members® questions# a 
defending their work against criticism. 

The Subcommittee did not write a report after its 
review# and the absence of a summary report has led to 
some confusion regarding the nature of its criticisms. 
Review of the transcript of its second meeting (SeptemJ 
5# 1980 ) and discussions with various participants in • 
review meeting have revealed several general criticism! 
of the Carcinogen Assessment Group® s risk assessments. 
One was that the documents provided to the Subcommitte* 
were not sufficiently detailed? i.e. # they did not pro¬ 
vide enough scientific information from the various 
studies cited to permit the Subcommittee to make an in< 
pendent assessment of the quality and validity of the 
studies. Another criticism raised by the Subcommittee 
was that the conclusions drawn did not reflect the 
quality of the data on which the risk assessments were 
based. Some Subcommittee members asserted that such 
considerations may# in fact# be precluded by rigid 
adherence to the Agency's guidelines for risk assessmer 

Other criticisms focused on specific issues# includj 
the validity of basing a conclusion of carcinogenicity 
an increase in mouse liver tumors# the importance of 
contaminants in the test chemicals# and the wisdom of 
using a single model for extrapolating from high to lov 
doses. The Subcommittee viewed these issues as primari 
scientific# whereas Agency staff considered them# althc 
resting ^on scientific principles# as resolvable through 
the choice of conservative policy options—a choice 
embodied in the Agency®s guidelines. These differences 
between the Subcommittee and Agency staff emphasize the 
conclusion set forth in Chapter I that many components 
risk assessment lack a firm scientific answer and requi 
a judgment to be made. In some cases# such judgments m 
be informed by scientific arguments# but may ultimately 
rest on policy preferences. The difficulties in common 
cation between the Agency and the Subcommittee also und 
score the importance of explicit risk assessments and 
written reviews. 

The differences reported above have not yet been ful 
^ Agency ' s experience with the Subconunitte 
has ^ SOm p^^ fiCUltieS in using a review body tha 

to iu tast SU rf 1C f nt “r t0 devel °P a w °tking appro* 

its task, it also emphasizes the importance of ex- 
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plaining Agency risk assessment procedures/ including the 
adherence to specific guidelines, to review panels. Con¬ 
cerns similar to those of the Subcommittee have been 
expressed by members of the Environmental Health Com¬ 
mittee, which replaced it, and Agency staff are currently 
considering changes in the risk assessment procedures 
embodied in their guidelines. 


PROPOSED CHANGES IN ORGANIZATIONAL ARRANGEMENTS 
FOR RISK ASSESSMENT 

Proposals to reform the organizational arrangements for 
risk assessment have been advanced to reduce perceived 
shortcomings in agency practices. The criticisms to 
which these proposals respond may be summarized as 
follows 2 

• Bias . Critics of agency performance suggest that 
decision-makers approach risk assessment with attitudes 
about regulation that preclude objectivity. Regulators, 
for example, may skew their assessment of risks associ¬ 
ated with a particular substance to support a preference 
to regulate or not to regulate that substance. 

• Exaggeration. This criticism is closely related 

to the first. The suggestion is that regulatory agencies, 
accustomed to operating in an adversary mode and expec¬ 
ting their judgments to be challenged in administrative 
hearings or in court, typically overstate the risks 
associated with hazards that they decide to regulate or 
understate the risks associated with hazards that they 
decide not to regulate. The instinct to support a posi¬ 
tion with every available argument may distort interpreta¬ 
tions of scientific data, choice of extrapolation 
procedures, and assumptions about human exposure. The 
critical role of legal staff in preparing agency 
documents is thought to foster the adversarial style. 

• Poor Public Understanding . If risks are misdes¬ 
cribed, it follows that public perception of the risks 
will be inaccurate. In addition, because agency announce¬ 
ments of regulatory actions typically stress the ultimate 
risk management strategy, such as the banning of sac¬ 
charin, and do not explain why a particular action is 
being taken, the public is led to infer the degree of 
risk from the action proposed or from the decision not to 
act. However, an agency's ultimate decision may be dic¬ 
tated by statutory language or regulatory policies that 
emphasize considerations other than degree of risk. 
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• Poor-Quality Personnel , This argument is 
straightforward, if unflattering. It is that regula 
agencies cannot attract or retain adequate numbers o 
highly qualified scientists to perform risk assessme 
Many of their personnel are removed from active rese 
by time and distance and are unfamiliar with the lat 
developments in their fields. 

• Inconsistency . This criticism supports propos 
for centralization of risk assessment. To the exten 
separation is a prerequisite to centralization, this 
criticism would also support institutional separatio 
The suggestion is simply that agencies have applied . 
sistent criteria and reached inconsistent results in 
assessing the risks posed by the same hazards. Such 
inconsistency is more likely when each agency is res] 
sible for performing its own assessment. 

• Redundancy . Starting from the assumption that 
different regulatory agencies have been, and are lik 
often to be, concerned with the same hazards, the cr 
argue that current arrangements force government reg 
tors, affected industries, and interested scientists 
deal with litigation on the risks of a given substan 
several times. Accordingly, a central institution 
responsible for performing risk assessments for all 
agencies might yield process efficiencies and reduce 
costs for all participants. 


DESCRIPTION OF PROPOSALS 


The central proposals for changes in institutional 
arrangements for risk assessments developed by the 0 
of Science and Technology Policy (OSTP) and the Amer 
Industrial Health Council (AIHC) and presented in H.: 
638 have sparked much of the current debate and prec 
tated this study. For several years before, however 
dissatisfaction had been expressed with the procedur 
which government bodies used scientific data and res 
what purported to be scientific issues. This dissat 
tion led to one of the precursors of the current pro 
sals: the idea of a science court for resolving sci 
tific issues underlying regulatory decisions. That 
suggestion and other, more recent proposals for proc 
and structural reforms are discussed briefly below, 
primary objective of this section, however, is to fa 
tate evaluation of the three main proposals that ins 
this study. 


Science Court 


An important precursor of the OSTP proposal was the 
science court concept of Kantrowitz (1975). The science 
court was proposed to assist decision-makers with disputed 
scientific aspects of a decision. Hence, a basic premise 
of the science court is that it is both possible and 
desirable to separate the scientific elements of a public- 
policy decision from social and political considerations. 
The judges of a court were to be impartial, competent 
scientists from relevant disciplines who were not involved 
in the dispute. These judges would hear testimony from 
scientific experts on both sides of the issue, who would 
be allowed to cross-examine each other. The rationale 
was that scientist advocates are best qualified to present 
their own cases and to probe the weaknesses of their 
opposition. In the environment created in such a court, 
complete objectivity would be neither assumed nor neces¬ 
sary. After hearing all witnesses, the judges would 
issue a summary of their opinion of the meaning of the 
scientific evidence. Their opinions would deal only with 
scientific questions and could not include recommenda¬ 
tions for public policy. Many details of a science 
court’s procedures and operations are, however, unclear• 
Even after several years of sometimes heated debate in 
the scientific and regulatory communities, the overall 
reactions to the concept can be characterized as at best 
only lukewarm. Although a genuine science court will 
probably not be established, the underlying idea of 
separation of scientific issues from social and political 
considerations in decision-making has since appeared in 
other proposals. 

FDA's creation and use of public boards of inquiry is 
the nearest analogue to the science court that has been 
put into practice. In 1975, FDA, on its own initiative, 
adopted regulations describing a public board of inquiry, 
a new kind of decisional body that could substitute for 
the traditional trial type of hearing before an adminis¬ 
trative law judge if parties to formal disputes before 
the agency could agree. A board of inquiry is an ad hoc 
panel of three independent scientists, qualified in 
relevant disciplines, who hear evidence and arguments and 
render a preliminary decision, which may be appealed 
(like that of an administrative law judge) to the Com¬ 
missioner of FDA. The procedure assumes that disputes 
that are primarily scientific can be resolved more 
accurately, faster, and with greater credibility by an 
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ood additives. Other regulatory disputes, including 
i-DA s refusal to approve the injectable contraceptive, 
Depo-Provera, are scheduled to be heard by boards of 
inquiry. 


OSTP Proposal 

A 1978 report from OSTP gave impetus to emerging proposa 
for reparation and centralization of scientific aspects 
oi r ink assessment. The report recommended several step 
to ensure consistency in the identification, characteriz 
t ion, and assessment of potential human carcinogens. Tvi 
interrelated stages in regulatory decision-making were 
delineated: Stage I, identification of a substance as i 
potential human carcinogen, qualitative and quantitative 
characterization of the risk it poses, and explication < 
the uncertainties? and Stage II, evaluation of regulatoi 
options and their consequences. This dichotomy closely 
parallels our own distinction between risk assessment ai 
rink management. The OSTP report recommended that a 
uniform decision-making framework be used in all agencii 
and that Stage I and Stage II functions be separated 
within or outside regulatory agencies while sufficient 
1 inkage® were maintained to ensure relevance and timeli 
n«i!8. Such organizational experiments as the Carcinoge 
Assessment Group in EPA were highlighted. The report 
also suggested that the then-fledgling National Toxi¬ 
cology Program might eventually assume an expanded rolt 
in coordinating or overseeing some risk assessments foi 
the regulatory agencies. 



H.R, 638 and the AIHC Proposal 


The 1978 OSTP report was a broad statement of principles. 
Two detailed proposals to create new risk assessment 
institutions have since been advanced. Because these 
proposals have several features in common/ but also 
present important contrasts, they are summarized together 
(Table III-8) . 

In February 1980, Representative William Wampler first 
introduced legislation (U.S. Congress, 1981c) to establish 
a National Science Council. H.R. 638 calls for the crea¬ 
tion of a new panel of scientists, entirely independent 
of the regulatory agencies, that would decide disputed 
scientific issues posed by regulatory initiatives. The 
AIHC had previously (1979) advanced a similar proposal to 
create an expert science panel that would evaluate the 
hazards of chemicals considered for regulation. Both 
proposals stress the importance of uniform, consistent 
resolution of the scientific questions underlying regu¬ 
latory decisions. Both espouse the separation of risk 
assessment from the design and selection of regulatory 
responses, and both would use independent scientific 
experts to perform the assessments. 

There are some basic differences between the two 
proposals. Under H.R. 638, any party could request 
referral of scientific issues to the National Science 
Council. The AIHC proposal specifies that, although any 
party may request a review, only federal agencies or 
Congress would have the authority to initiate mandatory 
review of scientific questions by the central science 
panel. H.R. 638 would apply only in formal adjudications. 
The AIHC proposal would apply to any agency proceeding in 
which risk assessment was at issue. Because rule-making 
is the primary mode for regulating hazardous substances, 
the AIHC proposal would apply to more regulatory actions 
than would H.R. 638. Under H.R. 638, decisions of the 
National Science Council would be binding on regulatory 
agencies. In contrast, assessments of the AIHC * s science 
panel would not bind the agencies, but would carry a 
presumption of validity, subject to rebuttal in later 
regulatory proceedings. 

The risk assessment bodies contemplated by the two 
proposals also differ in composition and procedures. The 
National Science Council would be a standing body of 15 
full-time voting members serving 2-year terms. Individual 
chemicals would be assessed initially by advisory panels 
made up only of Council members. Each panel would have 
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TABLE III-8 Comparison of Major Features of HJ . 638 
and the AIHC Proposal 


H.R. 638 

AIHC Proposal 

Structure: 


Single continuing panel 

Single continuing b< ty 

separate from agencies; 

with rotating membei i; 

centralized 

in the NASi* 


Membership: 


15 full-time members 

15 part-time members 


appointed by chairman of 

selected according t 

» 

NSB& from NAS nominees; 

NAS procedures; mem! 

;rs 

members to be qualified/ 

to represent the bes 


distinguished scientists 

scientists 


Scope: 

Referral by any party of 

Referral by any part 


adjudications involving 

or agency (only latt 

r 

harm to human health from 

require mandatory cc 

- 

substances considered by 

sideration) concerni 

g 

CPSC, FDA, OSDA,£ DHHS,^ 

proposed rules or 


OSHA/ and EPA 

agency adjudications 



all agencies with re 
latory jurisdiction 
would be affected 

u- 


Functions: 


Panel could prepare an 

Panel could prepare 

n 

independent risk assess- 

independent risk ass 

ss- 

ment; its decision would 

ment; its findings \ 

uld 

be binding on the agency 

be advisory, but wot: 
be part of record 

d 

Public Participation: 

Parties to adjudication 

Federal Register not 

ce 

would be involved 

of referral would sc 
submission of data t 
public 

icit 

Implementation: 

Legislation 

Legislation 



^National Academy of Sciences. 

^National Science Board. 

SCJ.S. Department of Agriculture. 
^Department of Health and Human Services. 
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at least five voting members. The AIHC science panel 
would be established under the umbrella of the National 
Academy of Sciences and consist of 15 part-time members 
who would serve for terms of 3 years. The panel could 
establish working groups, which could be composed largely 
of outside experts. These divergent approaches to place¬ 
ment and composition of the panels and terms of member s 
reflect different expectations about which status would 
attract the best scientists and perhaps about the extent 
to which the results would be binding. For example, the 
AIHC proposal assumes that distinguished academic and 
industry scientists would be unwilling to serve on a 
full-time basis for any substantial period. 

Under H.R. 638, the National Science Council would 
decide scientific questions after conducting a formal 
"hearing on the record," in which all parties to the 
agency proceeding could participate. Under the AIHC 
proposal, referral of scientific issues to the panel 
would be announced, and the submission of written evi¬ 
dence and arguments would be invited. The less formal 
procedures visualized by the AIHC are consistent with its 
objective of obtaining nonbinding expert judgments on 
scientific issues that underlie decisions. 

The two proposals embody different expectations as to 
speed of response. H.R. 638 would require the National 
Science Council to make a final report to the referring 
agency within 90 days of receiving a dispute. The AIHC 
proposal, however, imposes no time limits on the panel's 
assessment, except that the panel "operate expeditiously 
but not precipitously" (Higginson, 1982). 


Single-Agency Proposals 

H.R. 638 and the AIHC proposal espouse government-wide 
reform of the institutional means for risk assessment. 
Other notable recommendations for institutional restruc¬ 
turing have been addressed to individual agencies or 
agency programs. In 1981, for example, Senator Orrin 
Hatch introduced legislation (U.S. Congress, 1981d) to 
amend the food-safety provisions of the Federal Food, 

Drug, and Cosmetic Act. His bill included a provision 
permitting FDA to request, or affected third parties to 
demand, assessment of the risks associated with specific 
food constituents, with such assessment to be performed 
by a panel of scientific experts appointed by the National 
Academy of Sciences. The panel's assessment would be 
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advisory, rather than binding on the agency. Sin 
provisions have appeared in other proposals to re 
government regulation of food safety, including a 
developed by the Food Safety Council (1979). The 
posals appear to share assumptions underlying the 
proposals: that agency risk assessments cannot be 
to be objective, thorough, or expert and that an 
dent review should be available before a final de 
is made. These proposals for independent scienti 
panels differ from H.R. 638 in three important wc 
they would apply to one agency or program? they c 
plate only an advisory role, rather than a resold 
function, for the scientific panel? and they woul 
to any agency proceeding in which risk assessment 
at issue. The proposals thus can be viewed as ag 
program-specific illustrations of the AIHC propos 
create one central scientific panel to serve all 
One such single-agency proposal has been adopt 
1981, Congress amended the Consumer Product Safet 
(U.S. Congress, Omnibus Budget Reconciliation Act 
to require CP SC to consult with an ad hoc chronic 
advisory panel whenever it contemplates rule-maki 
cerning a product believed to pose a risk of canc 
defects, or gene mutation. A panel will consist 
members appointed by the Commission from among 21 
tists nominated by the President of the National 
of Sciences. Nominees may not be employees of th 
ment or have any financial ties to any manufactur 
seller of consumer products. Each nominee must h 
"demonstrated the ability to critically assess ch 
hazards and risk to human health presented by the 
sure of humans to toxic substances or as demonstr 
the exposure of animals to such substances." The 
responsibility is to prepare for the Commission a 
on the substance that the agency is considering r 
ting. The panel is to review the scientific data 
other information related to the substance and "d 
if any substance in the product is a carcinogen, 
or teratogen." The panel will also "include in i 
an estimate, if such an estimate is feasible, of 
able harm to human health that will result from e 
to the substance." The Act requires that a panel 
its report within 120 days of convening, unless t 
mission allows it additional time. A panel's rep 
"shall contain a complete statement of the basis 
determination." The Commission must consider the 
report and incorporate its evaluation into any ad 
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notice of proposed rule-making and any final rule. Appar¬ 
ently, the agency is not bound by a panel's determination 
of carcinogenicity or its estimation of the risk associ- 
ated with exposure. Although it appears that each panel 
is to perform its own risk assessment, the statute is 
silent on the role to be played by agency staff and on 
the weight that a panel might legitimately accord to 
analyses prepared by the agency itself. These panels are 
exempted from the Federal Advisory Committee Act? the 
exemption presumably means that they are not required to 
provide advance notice of their meetings or to deliberate 
in public. A panel may seek information from third 
parties, but only through CPSC. 


CRITICISMS OF PROPOSALS FOR SEPARATION AND CENTRALIZATION 

The four federal regulatory agencies have responded skep¬ 
tically to proposals to separate and centralize the func¬ 
tion of assessing the risks of chemicals that are can¬ 
didates for regulation (U.S. Congress, 1981b). Other 
observers have also found flaws in the proposals. A 
central criticism made by those who argue against full 
organizational separation between risk assessment and 
regulatory policy-making is that simply separating risk 
assessment from the regulatory agencies would not separate 
science from policy. This argument is based on the fact 
that the risk assessment process requires analytic choices 
to be made that rest, at least in part, on the policy con¬ 
sideration of whether to be more or less conservative when 
determining possible public-health risks. A second point 
is that, although extra-agency separation of risk assess¬ 
ment may help to minimize the influence of risk management 
considerations on this process, the agency responsible for 
deciding what exposure to permit or what costs to impose 
must make what is ultimately a political judgment based 
on the extent of risk determined in the risk assessment 
and often on the benefits and costs of regulatory action 
and its feasibility and political acceptability. For its 
decision to be politically acceptable and the decision¬ 
maker accountable, the agency must have responsibility 
for each of these components of regulatory decision¬ 
making. A third argument against institutional separa- 
tion is related to the internal process by which agencies 
reach decisions. It is claimed that this process is 
unavoidably an iterative one. Different specialists are 
called on repeatedly for analysis and advice as an agency 
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identifies and considers new control options in attempting 
to reach a decision. Although this description tiay over¬ 
state the fluidity of internal agency deliberat ans, it 
captures something of their ad hoc character. « Losely 
coupled with this argument is the necessity for agencies 
to retain scientific capability so that they ca under¬ 
stand what a risk assessment means and how to uj a it in 
developing risk management strategies. Thus, e m if 
risk assessment were performed outside the agen< r , a 
scientific staff representing many different di: uplines 
would still be required, to ensure that an assef intent 
would be interpreted and used correctly. 

Other criticisms of proposals for risk assess tent by a 
centralized panel stress the logistic difficult, as of 
meshing independent risk assessment activities \ th the 
internal workings of different agencies. Exper: ance 
suggests that it will be difficult for any risk ssess- 
ment body to meet even generous time limits. T1 is, agency 
decisions will probably be delayed by a requiren nt to 
consult, or refer issues to, such a body. A cei :ral 
panel also might become overburdened and cause i ditional 
delays. Critics of H.R. 638 and the AIHC propos il chal¬ 
lenge the assumption that the regulatory agencie have 
reached inconsistent conclusions in evaluating ^ irious 
chemicals. The recent differences in the regulc ion of 
formaldehyde constitute a rare example of dispai ite 
treatment of the same chemical, and even this di parity 
may not betray basic disagreement over the intei >retation 
of scientific data, as distinct from the degree f risk 
that justifies regulation. In the past, the age .cies 
have often selected different control options or imposed 
different exposure limits for a given chemical, ut these 
disparities have typically reflected differences in expo¬ 
sure (and thus in risk characterization) or dif 1 rences 
in regulatory policy or statutory or administrat ve 
requirements? none of the current proposals addr sses 
such differences. 


CONCLUSIONS 

The Committee was asked by the Congress to consi er "the 
merits of an institutional separation of scienti ic func¬ 
tions of developing objective risk assessment fr m the 
regulatory process of making public and social p licy 
decisions and the feasibility of unifying risk a sessment 
functions." In this chapter, the Committee has Idressed 
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these two issues and a third, related issue: the value 
of independent scientific review of agency risk 
assessments. 

In its review, the Committee was sensitive to a number 
of considerations, including the scientific quality and 
regulatory relevance of the assessments performed. It 
also tried to ascertain how scientific and policy consid¬ 
erations were handled in the performance of risk assess¬ 
ment. To reach its conclusions, in the absence of 
accepted criteria for evaluating agency practices and 
proposals for change and in view of the sparseness of 
relevant empirical data, the Committee has relied on 
discussions with other persons knowledgeable and experi- 
enced in risk assessment activities, the limited avail¬ 
able literature, and especially its own knowledge and 
experience in regulatory-agency risk assessments, as well 
as its review and analysis of past agency practices. 


VALUE OF INSTITUTIONAL SEPARATION 


1. Although organizational separation may help to ensure 
that risk management considerations do not influence 
the conduct of risk assessment, the degree of organi¬ 
zational separation that is optimal for individual 
agencies cannot be determined on the basis of the 
Committee's review. 


Regulatory programs differ substantially in their 
degree of organizational separation. In the cases of 
NIOSH assessments that in the early 1970s were adopted by 
OSHA and NRC assessments relied on by agencies, the 
assessment function has been outside the regulatory 
agencies. At EPA, the risk assessment units in the 
Office of Health and Environmental Assessment of the 
Office of Research and Development prepare assessments 
for regulatory program offices that are organizationally 
under different assistant administrators. However, the 
Office of Toxic Substances does its own assessments, and 
several other program offices are responsible for their 
own exposure assessments. The risk assessments for the 
FDA'S Bureau of Foods are produced within the Bureau, but 
by an office distinct from offices responsible for formu¬ 
lating regulations and enforcement? since 1976, the Direc¬ 
torate of Health Standards Programs in OSHA has both 
performed risk assessments and formulated all early risk 
management options. Different agencies also have success- 
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fully used different organizational arrangements for risk 
assessment* FDA, for example, has often called n NRC 
and NTP for assessments, but in other cases reli d on its 
own staff. The Committee's review of different jency 
structures and procedures did not demonstrate th t one 
particular structure produced risk assessments o superior 
quality and integrity. In addition, the Committ 2 notes 
that, even if there were a clear finding that a articular 
arrangement works for a given agency or program, it would 
be extremely difficult (given the diversity in a sncy and 
program mandates, personnel needs, and histories to 
justify a suggestion that that arrangement would )est 
serve all agencies or programs. 

2. Organizational separation has several importa : 
drawbacks that are likely to be intensified w dh 
increasing degrees of separation. 

There are several arguments against organizat anal 
separation. Separation of the risk assessment f iction 
from an agency 1 s regulatory activities is likely :o 
inhibit the interaction between assessors and re< ilators 
that is necessary for the proper interpretation : risk 
estimates and the evaluation of risk management < >tions. 
Separation can lead to disjunction between asses nent and 
regulatory agendas and cause delays in regulator proceed¬ 
ings. Common sense suggests that increased sepa at ion 
would aggravate these drawbacks. In its review, :he Com¬ 
mittee observed these disadvantages when assesso 3 and 
regulators were in different organizations (e.g. NIOSH 
and NRC). Another perceived drawback in extra-a sncy 
separation that was neither detected nor likely > emerge 
in the Committee's review is the erosion of scie :ific 
competence within agency staffs if risk assessmei :s are 
routinely performed outside the agency. Also, a r major 
organizational change may have a disruptive effe< : on 
agency performance; thus, such organizational ch lges are 
especially questionable when the benefits, if an; are 
unclear. 

3. Organizational arrangements that separate ris 

assessment from risk management decision-maki f will 
not necessarily ensure that the policy baslsj : 
choices made in the risk assessment process i clearly 
distinguished from the scientific basis of su i 
choices. 
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If risk assessment as practiced by the regulatory 
agencies were pure science, perhaps an organizational 
separation could effectively sharpen the distinction 
between science and policy in risk assessment and regu¬ 
latory decision-making. However, many of the analytic 
choices made throughout the risk assessment process 
require individual judgments that are based on both scien¬ 
tific and policy considerations. The policy considera¬ 
tions in risk assessment are of a different character 
from those involved in specific risk management decisions 
and are generally common to all assessments for similar 
health effects. Thus, even when one has drawn the rela¬ 
tively obvious distinction between risk assessment and 
risk management, there remains the more difficult task of 
distinguishing between the science and policy dimensions 
of risk assessment itself. We believe that the latter 
distinction cannot be ensured or maintained through organ¬ 
izational arrangements. Given the inherent mixture of 
science and policy in risk assessment, organizational 
separation would simply move risk assessment policy into 
a different organization that would then have to become 
politically accountable. The Committee believes that 
other approaches are more likely to maintain the distinc¬ 
tion between science and policy in risk assessment, most 
notably the development of and adherence to guidelines. 


VALUE OF CENTRALIZATION 

4. Common risk assessments performed primarily by scien¬ 
tists from all interested agencies on an ad hoc basis 
may capture the major advantages of centralization 
without the drawbacks that accompany permanent, 
extra-agency centralization . 

An argument often advanced for centralization is that 
it might expedite and perhaps reduce the administrative 
costs of decision-making when two or more agencies contem¬ 
plate regulation of the same substance. And if two or 
more agencies are going to regulate the same substance, 
there is much to be said for developing a system that 
facilitates production of a single, common risk assess¬ 
ment. This was one rationale for CPSC's decision to 
empanel a group of scientists to evaluate the carcinoge¬ 
nicity data on formaldehyde, and it argues in support of 
the central panels suggested in H.R. 638 and the American 
Industrial Health Council's proposal. Although the Com- 
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r ^ ^ ess san 9 uine concerning he pr< 

1 : ‘' 4: <r,an * >nt arrangement for such central zed rj 
COntemplated by these proposa s, in 
, oi centralize d assessment is inext LcabL 

/ .,./ f X '\ T ^ , r^ nCy separati °n- The Committee >nclu< 
1 d fi i separation would have di sad van iges \ 
m >*'• d t any advantages. 

*^*muttee did find, however, that ag icy s< 
iuborafce to perform joint risk ass< ismenl 
Because agency scientists wo Ld pel 

” • ’’.ouch an arrangement would avoid lost < 

: ! tv: ' extra-agency separation. The* >mmit 

* , i it the Panel on Formaldehyde as an e: imple 
" ;• * i) a 1 assessment group. In the Corami :ee*s 

* ;,t4 ^ ' functioned well and produced an as iessm< 

* ' - accepted by the scientific coramuni r . T! 

* * 1 * 1;; aii;i«»nninent has not produced parallel regu! 
■ i ci -oorvj the agencies, and the Comraitte< obse 
r ti s "aniLir risk assessments should not nec ssar 
1 'c\iitr regulatory decisions, which refl< t co 
f, ‘ i that often justify different risk n nagei 


*v : ■ * , * ‘ l K OTl FIC REVIEW PANELS 

. 1 vl«*p»cH«uit scientific review of agency i sk 
v ,io*nt: :i improves the scientific quali y of 
i * and strengthens them against atec 

o'ci * 

oevc unu and programs with mandated peer evie 

•su<*;. ,i;t HP A* n Off ice of Pesticide Programs, lich 
2 «« r**<i t.o mlmit to a Scientific Advisory ane] 

%i , ", i i cancel or restrict pesticide use, pr 3uce 
> nin acciMiiriwntu in support of regulatory de isic 
..I?** fally of high scientific quality and ire 
< y ?b«. public and the regulated parties. In :ont 
i ! # f’ binuni f ,1 ee found several cases in which m 3har 
r review could be markedly improved: OSH , wl 
j.uhUr comments to refine its risk assessmen h i 
f t orimil peer review; NIOSH, which has no ha< 
<i ? iinm to ensure that reviewers* comments are live 
riute consideration? and FDA*s Bureau of Fo Is, 
'juici ad hoc panels to review its assessments a i 
!. hat unfortunately can be circumvented). 
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• Standing and continuing review panels that have 
mechanisms to maintain the independence of their 
members appear to be the most useful review bodies . 
Continuity and independence of review panels help to 

ensure that such panels are sensitive to regulatory needs 
while retaining the necessary scientific objectivity. 
Examples of standing committees, such as the Scientific 
Advisory Panel in EPA, support this perception. Con¬ 
versely, the Committee observed that short-lived or ad 
hoc groups, such as the Subcommittee on Airborne Carcino¬ 
gens, often do not have sufficient time to develop a 
working relationship among panel members and that much of 
the time allotted to review is actually spent in clarify¬ 
ing individual versus panel viewpoints and understandings. 
Similarly, an ad hoc panel may not clearly understand its 
role in relation to the regulatory process• Thus, stand¬ 
ing panels appear to be of greater value to the agency 
than ad hoc committees• Furthermore, the existence of a 
standing panel might encourage an agency to seek its 
advice more frequently. 

Because it is important for review committees to be 
free to express their scientific judgments without 
concern for regulatory implications, panels that are 
formed in a manner that neither compromises nor appear s 
to compromise their independence are more likely to 
improve ultimate risk assessments. The Committee observed 
that several review panels used by EPA already have a 
nomination process that places the responsibility for 
developing a slate of possible panel members outside the 
agency. Although the EPA Administrator makes the final 
selections of panel members, the fact that nominations 
come from outside the agency emphasizes the intent that 
EPA panels be independent and as free of agency influence 
as possible. A related point is that membership on EPA 
panels, and in fact on most review panels used by the 
regulatory agencies, rotates? members are usually selected 
for staggered, fixed terms (generally 3-4 years). This 
rotation itself reduces the likelihood that members will 
develop an institutional bias. 

• Review panels are best qualified to give scien¬ 
tific advice when they are composed of scientists who 
are highly knowledgeable in the appropriate 
disciplines . 

For carcinogenicity risk assessments, for example, 
some relevant disciplines would be toxicology, pathology, 
biostatistics, chemistry, and epidemiology. The Com- 
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mittee believes that professional or organization 
affiliation should not be used as a primary crite 
the determination of the makeup of a particular p 
That is, in contrast with the advisory panels use 
OSHA, which are constituted to reflect balance am< 
different affiliations and presumed biases, the C 
believes that scientific competence must be the p 
factor determining panel membership if review pan 
to be asked to give their advice on the scientific 
of an agency 1 s risk assessments. However, the Co: 
notes that panel members who understand the polic: 
cations of their scientific judgments are more li 
be helpful to an agency's assessment process and i 
attempt to balance viewpoints of scientifically q 
panel members may increase a panel's credibility. 

* Review panels will be most effective if the; 
the authority to review agency risk assessment 
announcement of the agency's intended regulato 
actions, except in cases of emergency. 

The Committee believes that review panels serv: 
regulatory agencies should serve in an advisory c« 
That is, the judgments of a panel should not be b: 
on the agency. Nevertheless, the Committee also 1 
that the authority of agency review panels should 
that agencies must demonstrate that adequate cons; 
has been given to reviewers 1 judgments, and prior 
tation with review panels helps to ensure this. I 
announcements of intended actions or proposed regi 
must be thoroughly developed and substantiated, r< 
the time of announcement or later is likely to be 
to influence an agency; although the regulation is 
proposed, the decision of whether to act has, for 
practical purposes, already been made. In the Coi 
tee's judgment, exceptions to this idea of prior i 
are appropriate in the case of emergency actions, 
suspension of pesticide registration. Risk assess 
supporting such actions could be reviewed after tl 
announced action. 

* Independent panels with authority to review 
assessments for all agency regulatory decisions 
including decisions not to act, are more likely 
ensure that agency decisions rest on valid sci< 
grounds. 

Panels with the authority to request the reviev 
agency risk assessment supporting a particular reg 
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decision will have a greater impact on agency decision¬ 
making. For example, if a panel can review only assess¬ 
ments referred to it by an agency, some agency decisions 
might not benefit from independent review of their scien¬ 
tific basis. This is especially likely if an agency has 
decided not to regulate. Such a decision may have con¬ 
siderable impact and should receive the same careful 
review as decisions to regulate. In addition, panels 
with the authority to request reviews can respond to 
suggestions for review from the public. 

• Although most requirements of the Federal 
Advisory Committee Act are salutary, others may 
inhibit agency use of review panels. 

The Committee believes that most provisions of the Act 
are beneficial and endorses such provisions as the 
requirement that advisory committees meet in public and 
provide advance notice of their meetings. However, the 
Act does impose requirements, some burdensome, for agency- 
created bodies that meet the definition of advisory 
committee . Notably, the Act requires that an advisory 
committee be formally chartered by an agency head and 
approved by the General Services Administration. This 
procedure has often proved cumbersome. Some agencies, 
such as FDA, lack independent chartering authority and 
thus require approval at the departmental level. In 
addition, procedures used by the General Services Adminis¬ 
tration for screening new committees have often imposed 
long delays, sometimes inspired by political concerns 
about committee membership or by resistance to the crea¬ 
tion of new government "agencies." These legal require¬ 
ments of the Act have caused some agencies to seek other 
ways of obtaining the views of scientific experts, 
especially when the issues involve single chemicals or 
tests. In such cases, regulators often confine their 
consultations to government scientists, who can be 
accessible immediately and, if necessary, for extended 
periods. 

• Written reviews help to ensure agency 
consideration of scientific criticism. 

A summary of a panel's review that is transmitted in 
written form and made available to the public will help 
to avoid confusion and to ensure agency consideration of 
the panel's comments. As mentioned earlier, in the 
absence of adequate mechanisms to ensure agency consider¬ 
ation of reviewers' comments, the comments might be 
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ignored, or the public might perceive that they a 
ignored. Putting its summary in writing should a 
ensure that the panel states its findings clearly 
make it more likely that the agency will interpre 
comments correctly. 


OTHER OBSERVATIONS 


6. Preparation of fully documented written risk a 
ments that explicitly define the judgments mad 
attendant uncertainties clarifies the agency 
decision-making process and aids the review pr 
considerably. 

When a fully documented written risk assessmer 
produced before an agency's decision to regulate 
to regulate, it is difficult to understand the pr 
which an agency made its assessment. The Committ 
believes that the creation of such a document enc 
public understanding of and respect for agency pr 
and provides a basis for review by a scientific a 
panel. Furthermore, a detailed risk assessment d 
that clearly identifies the inference options chc 
the assessment and explains the rationale for tho 
choices will help to maintain a sharper distinct! 
between science and policy in the assessment of r 
will guard against the inappropriate intrusion of 
management considerations• 
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IV 

Recommendal ions 


The Committee has reviewed federal risk assessment for 
hazards to public health, particularly for chemica ly 
induced cancer, and has presented its findings cor erning 
the nature of risk assessment, the nature and util ty of 
risk inference guidelines, and the effects of alte native 
organizational arrangements on risk assessment. 1 e Com¬ 
mittee's review leads to the general observation t at the 
process of risk assessment, as performed by and fc fed¬ 
eral regulatory agencies, has been developing rapj ly in 
recent years, both with respect to its scientific asis 
and with respect to the agencies' organizational a range— 
ments. Change this rapid is bound to lead to misu der- 
standing about the use of risk assessment in regul tory 
policy-making, particularly if some misconstrue ri k 
assessment to be a strictly scientific undertaking Much 
of the criticism of risk assessment stems from dis atis- 
faction with regulatory outcomes, and many proposa s for 
change are based largely on the unwarranted assump ion 
that altering the administrative arrangements for isk 
assessment would lead to regulatory outcomes that cities 
will find less disagreeable. Because risk assessir nt is 
only one aspect of risk management decision-making how¬ 
ever, even greatly improved assessments will not 
eliminate dissatisfaction with risk management dec sions• 
The Committee believes that the basic problem w th 
risk assessment is not its administrative setting, out 
rather the sparseness and uncertainty of the scien ific 
knowledge of the health hazards addressed. Reorga Lza- 
tion of the risk assessment function will not crea 0 the 
data and underlying knowledge that assessors need d make 
risk assessments more precise. We hold that the m st 
productive path to a solution has three parts: 
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• Implementation of procedural changes that ensure 
that risk assessments take full advantage of the avail¬ 
able scientific knowledge while maintaining the diverse 
organizational approaches to administration of risk 
assessment needed to accommodate the varied requirements 
of federal regulatory programs, 

• standardization of analytic procedures among fed¬ 
eral programs through the development and use of uniform 
inference guidelines, 

• Creation of a mechanism that will ensure orderly, 
continuing review and modification of risk assessment 
procedures as scientific understanding of hazards 
improves. 

The Committee offers in the following pages 10 recom¬ 
mendations whose implementation it believes will meet 
these general objectives. 

IMPROVING RISK ASSESSMENT THROUGH PROCEDURAL CHANGES 
RECOMMENDATION 1 


Regulatory agencies should take steps to establish and 
maintain a clear conceptual distinction between assess¬ 
ment of risks and the consideration of risk management 
alternatives; that is, the scientific findings and policy 
judgments embodied in risk assessments should be 
explicitly distinguished from the political, economic , 
and technical considerations that influence the design 
and choice of regulatory strategies . 

Although the Committee concludes that risk assessment 
cannot be made completely free of policy considerations, 
it also believes that policy associated with specific risk 
management decisions should not influence risk assessment 
unduly. Risk assessment and risk management involve dif¬ 
ferent goals, kinds of expertness, and operating prin¬ 
ciples. The goal of risk assessment is to describe, as 
accurately as possible, the possible health consequences 
of changes in human exposure to a hazardous substance; 
the need for accuracy implies that the best available 
scientific knowledge, supplemented as necessary by assump¬ 
tions that are consistent with science, will be applied. 
The ultimate aim of risk management is to evaluate trade¬ 
offs between health consequences and other effects of 
specific regulatory actions; this evaluation includes the 
application of value judgments to reach a policy decision. 
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Experience shows the difficulties that can arise f Dm 
a blurring of the distinction between the two element . 

If risk management considerations (for example, the e d- 
nomic or political effects of a particular control ac Lon 
for a particular chemical) are seen to affect either tie 
scientific interpretations or the choice of inference 
options in a risk assessment f the credibility of the 
assessment inside and outside the agency can be compr - 
mised r and the risk management decision itself may lc e 
legitimacy. Indeed, such consequences can flow from tie 
mere perception, as well as the fact, of such influer es. 
Each regulatory agency should commit itself to safegu rd- 
ing the distinction between the processes of risk ass ss- 
ment and risk management. One among several suggesti ns 
for accomplishing this safeguarding is to restructure the 
formal organization, separating an agency's or progra 's 
risk assessment staff from its policy-making staff, i >s- 
sibly by establishing a separate risk assessment unit 
outside the agency. The Committee does not, however, 
recommend that agencies use any particular organizati nal 
arrangement for risk assessment. One might surmise t iat 
separating the staffs would help to reduce the likeli ood 
that risk management considerations will influence r j ;k 
assessment, but our survey of agency structures prova ed 
no clear evidence that such an influence was related .o 
the degree of administrative separation. 

Formal separation has disadvantages that must be l il- 
anced against its value in maintaining a distinction 
between risk assessment and risk management. Risk as iess- 
ment and risk management functions are analytically c s- 
tinct, but in practice they do—and must—interact. 
Organizational arrangements that completely isolate i sk 
assessors from regulatory policy-makers may inhibit : ipor- 
tant communication in both directions. For example, :o 
complete risk characterization, risk assessors must 1 low 
what policy options are to be used to calculate alte] 1 a- 
tive projected exposures, and new options may develo] as 
the risk management process proceeds. Moreover, dir< :t 
communication with the risk assessors is desirable t< 
ensure that the regulatory decision-maker understand} the 
relative quality of the available scientific evidenc r 
the degree of uncertainty implicit in the final risk 
assessment, and the sensitivity of the results to th< 
assumptions that have been necessary to produce the 
assessment. Such separation could also impair the r sk 
manager' s ability to obtain assessments that are tim» Ly 
and in a useful form. The advisability of organizat Dnal 
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separation hinges on comparison of its benefits and costs 
in particular agencies and programs. 

Because drawbacks are likely to be most pronounced in 
the case of extra-agency separation, the Committee does 
not believe that it is appropriate to remove the risk 
assessment function and place it in an organization com¬ 
pletely separated from the regulatory agencies, as is 
contemplated in the AIHC proposal and H.R. 638, This 
judgment is supported by the conclusion that the benefits 
of increased separation are uncertain and that the disrup¬ 
tion and confusion caused by reorganization could be 
considerable. 

Measures other than organizational separation can 
ensure the distinction between the assessment of risk and 
the consideration of risk management alternatives. These 
measures include the practice of preparing written risk 
assessments (Recommendation 2) , arranging for independent 
peer review (Recommendation 3) , and adhering to uniform 
guidelines for risk assessment (Recommendations 5 through 
9). 


RECOMMENDATION 2 


Before an agency decides whether a substance should or 
should not be regulated as a health hazard, a detailed 
and comprehensive written risk assessment should be 
prepared and made publicly accessible. This written 
assessment should clearly distinguish between the 
scientific basis and the policy basis for the agency’s 
conclusions. 


Although agencies commonly perform risk assessments 
before they take regulatory actions, the written assess¬ 
ments that are prepared vary in coverage, amount of 
explanatory detail, format, and completeness to an extent 
that limits their use as instruments of communication. 

The Committee believes that the matters addressed are so 
important and the consequences so far-reaching that a 
written risk assessment should be prepared for every 
significant regulatory decision and that each should be a 
clear, detailed, and comprehensive account of the analysis 
performed. A written assessment should describe the vol¬ 
ume and weight of scientific evidence to help to clarify 
the scientific and policy bases for regulatory decisions. 

The written assessment should be made accessible to the 
public at a time and in a form that facilitates public 
participation in any attendant risk management decision. 
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The Committee believes that the requirement to repare 
a written assessment imposes a salutary discipline that, 
for several reasons f will improve the performance f risk 
assessment. First, the requirement to prepare a c mpre- 
hensive written assessment will encourage the agen y to 
explain how each component of the assessment was t eated; 
that should minimize the likelihood that risk mana ement 
considerations will, unnoticed, affect the outcome of the 
assessment. Second, a written assessment can help to 
distinguish the factual basis of a risk assessment from 
inferences drawn where there is a lack of scientii c 
consensus; this distinction will facilitate scienl .fic 
review of the risk assessment, document the scient fic 
basis of the assessment for outside observers, an< 
acquaint the regulatory decision-maker with the r« .ative 
completeness of the scientific evidence. Third, : : will 
aid communication among specialists working on diJ :erent 
parts of the assessment. Fourth, the existence o: an 
explicit description should simplify the conduct < later 
assessments of the same chemical, if additional s< Len- 
tific evidence comes to light or other regulatory 
programs review the same substance. Finally, wri :en 
risk assessments will be useful to institutions tl it 
oversee regulatory agencies, notably Congress and those 
responsible for judicial review. It is important 
however, that the format and scope of written ass ssments 
not become an independent basis for legal attack. 


Content and Form 

An agency's written risk assessment should set fc th in 
detail the nature and quality of the relevant sci ntific 
evidence concerning the substance in question and should 
cover all relevant components of risk assessment. It 
should reflect attention to any applicable guide! nes 
relied on in interpreting the evidence, so that a reader 
can ascertain what inference options were used, z .d should 
describe the scientific rationale for any departi; es from 
methods prescribed in such guidelines. If the cl >ice of 
inference options is not governed by guidelines, he 
written assessment itself should make explicit tl s assump¬ 
tions used to interpret data or support conclusic is 
reached in the absence of data. The document she lid 
acknowledge gaps and uncertainties in available 
information. 
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An agency's written assessments are likely to prove 
most useful if they follow a consistent format f so that 
readers, once familiar with the format, can use them 
efficiently. We believe that each program or agency can 
establish a uniform structure for its written assess¬ 
ments, and we hope that similarity, if not uniformity, 
will be possible in written assessments prepared 
throughout the government. 


Actions Covered 


This recommendation is not intended to apply to the risk 
posed by every substance, use, or exposure that engages 
an agency*s attention. It is intended to apply to agency 
decisions concerning important human exposure to a hazard. 
Such decisions would include (but not be limited to) 
establishment of an occupational safety and health stan¬ 
dard by OSHA, cancellation by EPA of the federal regis¬ 
tration of a pesticide to which there is widespread human 
exposure, and EPA promulgation of limits for an air or 
water pollutant. The categories of actions covered by 
this recommendation could be defined precisely only after 
detailed statutory analysis. EPA appears to have had 
satisfactory experience with the practice of classifying 
its regulations as "major” (those with very large economic 
and other effects that require an extensive regulatory 
analysis and formal review by the Office of Management 
and Budget), "significant" (a larger category defined by 
internal EPA criteria), and "minor" (a similarly large 
group of routine and technical actions)• We suggest that 
EPA prepare a written assessment for every major and 
significant action, and we encourage other agencies to 
devise similar methods of identifying which regulatory 
actions require written assessments. 

An agency's decision to refrain from regulation can 
often have important consequences, both for health and 
for the economy, and such decisions should rest on 
accurate, objective assessments of risk. The denial of a 
petition to act on a chemical to which exposure is 
extensive is an example. When an agency is confronted 
with choosing between limiting exposures to a substance 
and taking some lesser action and there is serious dispute 
over the character or extent of the risk posed, a written 
assessment is advisable. 


RECOMMENDATION 3 


An agency 1 s risk assessment, should be reviewed by i 
independent science advisory panel before any majo 
regulatory action or decision not to regulate# Pe : 
review may be performed by science panels already 
established or authorized under current law or, in :he: 
absence, by panels created for this purpose, 

• If an agency 9 s workload is substantial, a 
standing advisory panel (or panels) should be esta Lis] 
to review its risk assessments; otherwise f ad hoc me. 
should be established on a case-by-case basis* 

• Panel members should be selected for their 
scientific or technical competence. 

• The appointment of members should be the 
responsibility of each agency director, but nomina Lon 
from the public and scientific organizations shoul be 
invited f unless current law prescribes another pro< »du, 

• Panels should provide to the referring agenc is 
written evaluations of agency risk assessments, an* jth 
evaluations should be available for public inspect >n. 

This recommendation endorses outside peer revie of 
agency risk assessments. Such review should contr; >ut< 
to the important distinction between risk assessme: : a 
risk management f because risk management informatic i 
would be excluded from the review; should improve ie 
scientific quality of the assessments through the j oc< 
of criticism and response; and should increase the ire< 
bility of agency assessments. The practice of prei rii 
written risk assessments will facilitate the reviei 
process. 

The peer review function that we visualize is a. ea< 
evident in some agencies. We believe that a single 
approach would not fit all contexts f but that any i ch¬ 
an ism for scientific peer review should meet the ge er< 
criteria described below. 


Panel Form 


The review function we recommend could be performec 
effectively by an appropriately qualified standing am 
of independent scientists that is responsible for i vi 
ing agency assessments of a particular class of haz rdi 
Any agency program responsible for a large number c 
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compounds to which humans are exposed in large amounts 
seems to be an appropriate candidate for a standing 
scientific review panel, but some programs may deal with 
so few chronic health hazards that a standing panel is 
not warranted* The Committee specifically contemplates 
that the review function recommended here can be per¬ 
formed by panels already available to several agency 
programs. 


Panel Composition and Selection 


Members of a scientific review panel should be selected 
for their competence in fields relevant to the assessment 
of risks of the kind being evaluated. In our judgment, 
employees of private business organizations, members of 
environmental groups, and government research or regula¬ 
tory agency employees should not necessarily be disquali¬ 
fied? but no panel members should be employees of the 
agency whose risk assessments are to be reviewed, nor 
should any members participate in the review of sub¬ 
stances in which they or their employers have substantial 
economic or other interests or on whose risks they or 
their employers have publicly taken a position. It is 
important to safeguard both the reality and the appear¬ 
ance of complete objectivity for each review. 

We contemplate that, as is common for existing panels, 
the appointing official would be the head of the agency 
whose risk assessments are to be reviewed. Such an 
arrangement could be thought to jeopardize a panel's 
independence from the agency, particularly in cases in 
which it is known which chemicals the panel will review. 
Accordingly, each agency should establish procedures for 
obtaining nominees for panel membership whose objectivity 
is ensured. For example, some current procedures call 
for agency selection of members from lists of nominees 
provided by the President of the National Academy of 
Sciences and by the Directors of the National Institutes 
of Health and the National Science Foundation. We see no 
magic in any particular nomination process. The impor¬ 
tant objective is a process that, first, ensures that 
panel members are selected for their training and experi- 
ence in relevant fields? second, prevents the appointing 
official from forming a panel that will produce (or appear 
to produce) a predetermined result? and, third, operates 
expeditiously. We recommend that this process include an 
opportunity for members of the public to nominate persons 
for panel membership. 
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Panel Functions 

Our recommendation contemplates that, in a typical ase, 
the responsible agency will have prepared a written 
assessment of the risk posed by a substance. The i de¬ 
pendent scientific panel would be asked to review tl it 
assessment for comprehensiveness, scientific accura {, 
and consistency with any applicable risk assessment 
guidelines. If such guidelines are flexible, an im; Dr- 
tant panel function will be to ensure that departun s 
from the inference options favored by the guideline are 
justified on scientific grounds. In performing thi, role, 
the panel should, if it desires, have access to all the 
data available to the agency, including those on wh :h 
the agency 1 s analysts relied, as well as the agency s 
written assessment. The panel should subject the a< ancy's 
risk assessment to such scrutiny as the members fin 
necessary to satisfy themselves that it is, with or with¬ 
out revisions, as complete and objective as availab s 
data permit. The panel should provide a written ev Lua- 
tion of the agency 1 s risk assessment, including rec ranen- 
dations for revision, if appropriate. This evaluat an 
should be available for public examination by the t tie 
the agency initiates public proceedings to alter hui in 
exposure to the substance in question for example, len 
the agency issues a notice of proposed rule-making. 


Panel Agenda 

Independent review of agency risk assessments is de Lgned 
to ensure the integrity and quality of the scientif : 
bases for regulatory decisions affecting human heal l. 
Therefore, the Committee recommends that every acti< i, 
including a decision not to regulate, that requires i 
written risk assessment be available for independen 
scientific review. A scientific review panel's age la 
may also include risk assessments for other decisioi i of 
interest to panel members, or its review could be 
initiated after a request by a third party. In the 
latter case, panels should have the authority to de< Lde 
whether or not to respond to such requests for revi< /. 

In general, the Committee expects that the panels w aid 
exercise discretion in invoking their authority to sview 
assessments for routine, minor actions. 




Timing of Review 


Independent scientific review of agency risk assessments 
should occur before an agency commences the public process 
leading to regulatory action. The purpose is to expose 
the agency's initial assessment of the risk posed by a 
substance to expert scrutiny at a time when review can 
influence the agency's course of action. Experience 
suggests that agencies are less receptive to criticism of 
the basis of their actions after they have announced a 
proposed course of action. Furthermore, although inde¬ 
pendent review can sometimes forestall misguided regula¬ 
tory actions even after they are initiated, prior review 
of such actions may help to avoid serious damage to agency 
credibility and unnecessary costs to private interests 
that would be adversely affected by public proposals for 
regulatory action. We recognize an important exception 
to our general recommendation of preaction peer review. 
Several statutes expressly empower agencies to act in an 
emergency to curtail human exposure to a substance that 
poses a serious health risk. Agencies have also devised 
informal procedures to effect immediate protection of 
humans exposed to dangerous substances in other contexts. 
Our recommendation is not intended to cast doubt on the 
legitimacy of such authority or to impede its appropriate 
exercise. When an agency concludes that a hazard warrants 
immediate regulatory action to limit human exposure, it 
should be able to take action consistent with existing 
law without first going through the review process that 
we recommend. Promptly thereafter, however, the agency 
should submit its written risk assessment for independent 
review in accordance with the procedures outlined here. 


Weight of Panel Evaluation 

A scientific review panel's critique of an agency's risk 
assessment should not be binding; that is, the agency 
should not be obliged to revise its risk assessment if 
the panel regards it as deficient. Agencies have a 
responsibility to state the basis of their actions, and 
the authority for their actions must remain their own. 
Serious panel criticism, however, would in practice cause 
any agency at least to reconsider, and ordinarily to 
revise, its risk assessment. The agency should discuss 
any important criticisms of its assessment in its proposed 
regulatory action, and its response to a panel's criti- 
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cisms would be an appropriate subject for public coir ent, 
as well as a possible basis for judicial challenge t any 
final action. 

We believe that an important benefit of peer revi w 
occurs before the review begins: risk assessors who 
expect an assessment to be subjected to serious scru iny 
by eminent qualified reviewers are likely to be more 
careful and clear about the use and limits of scient fic 
evidence. 


Federal Advisory Committee Act 

The Federal Advisory Committee Act imposes many salu ary 
requirements on panels established to advise federal 
agencies, including notably the requirement that par 1 
meetings be held in public. But the Act's requireme t 
that new advisory committees be chartered by the Ger ral 
Services Administration imposes substantial delays a d 
its requirement that panel meetings be announced in he 
Federal Register at least 15 days in advance can mar edly 
slow a panel's work. Consideration should be given o 
modifying both requirements or exempting such panels from 
the Act, as Congress did for CPSC's Chronic Hazard 
Advisory Panels. 


RECOMMENDATION 4 

When two or more agencies share interest in and juri dic ¬ 
tion over a health hazard that is a candidate for re illa¬ 
tion by them in the near term, a joint risk assessme t 
should be prepared under the auspices of the Nations 
Toxicology Program or another appropriate organizati rw. 
Joint risk assessments should be prepared primarily £ 
scientific personnel provided by the agencies and 
assisted as necessary by other government scientists 

This recommendation endorses coordination in asse sing 
the risks of chemicals that are likely candidates fc 
regulation by two or more agencies. Although all th end 
uses of a substance may fall within the jurisdictior of 
one agency (such as FDA for a food additive), exposu es 
occurring during production, transportation, and dis ri- 
bution usually are within other agencies' jurisdicti ns. 
Thus, chemicals that pose a hazard to human health c e at 
least theoretically subject to regulation by two or ore 
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federal agencies. The Committee agrees with proponents 
of the centralization of risk assessment responsibilities 
that the agencies involved should operate on the basis of 
a common assessment of the substance's risks. However, 
the Committee differs with respect to the method for 
achieving this end. 


Actions Covered 


Our recommendation does not call for the performance of a 
joint risk assessment in every instance in which a sub¬ 
stance potentially falls within the jurisdiction of two 
or more agencies; we limit our proposal to circumstances 
in which assessment by more than one agency is likely in 
the near future. This limitation has two rationales. 
First, substantial risk may be associated with routes of 
exposure of concern to only one agency. Under such cir¬ 
cumstances, it would be unreasonable to invest time and 
resources to establish an interagency panel of scientists. 
Second, even if different types of exposure entail risks, 
a substance may legitimately rank low in priority for one 
agency and high for another. 


Placement and Procedures 


The approach we visualize is similar to that followed in 
1980, when the Interagency Regulatory Liaison Group, at 
the suggestion of CPSC, sought the assistance of the 
National Toxicology Program to examine the careinoge- 
nicity of formaldehyde. The Program formed an ad hoc 
panel that consisted entirely of government scientists, 
including some from EPA, OSHA, and FDA. 

We suggest that the National Toxicology Program be the 
usual vehicle for coordinating preparation of joint risk 
assessments. The National Toxicology Program has been in 
operation for several years and, in the Committee's judg¬ 
ment, has performed capably as coordinator of federal 
toxicologic research. It has displayed an ability to 
command the service of the government's best scientists. 
And it has developed effective working relationships with 
the regulatory agencies, which have become accustomed to 
looking to it for assistance in evaluating substances 
that are candidates for regulation. 

We expect that suggestions for establishment of an 
interagency task force to evaluate a hazard will come 
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from the interested regulatory agencies. The person] *1 
assigned to assemble the relevant data and perform t. 2 
assessment could include scientists from the interesi id 
regulatory agencies, including the initiating agencl 3, 
and scientists from government research organizations 
such as the National Institute of Environmental Heal 1 
Sciences, the National Cancer Institute, and the Nat: mal 
Center for Toxicological Research, The Committee re< )m- 
mends that task forces follow the same guidelines us< l by 
the regulatory agencies. Joint risk assessments shoi Ld 
be subjected to independent scientific review. 

For reasons presented in the discussion of Recomm< Na¬ 
tion 1, the Committee believes that such an ad hoc 
approach is preferable to creation of a centralized . Lsk 
assessment body. 


IMPROVING RISK ASSESSMENT THROUGH 
UNIFORM INFERENCE GUIDELINES 

RECOMMENDATION 5 

Uniform inference guidelines should be developed for :he 
use of federal regulatory agencies in the risk asses cient 
process. 

In the Committee's judgment, the development of ui :form 
inference guidelines is feasible and desirable, How* r er f 
the Committee emphasizes that guidelines cannot prov ie a 
formula for automatically calculating risk from avail ible 
data? case-by-case scientific interpretation will st, .1 
be crucial, and risk assessments must reflect experts 
characterizations of the quality of the data and of 1 le 
uncertainty associated with the final assessment. 

Adherence to uniform guidelines has several advan' iges 
over ad hoc performance of risk assessments. Guidel; ies 
could help to separate risk assessment from risk man< le¬ 
nient considerations, improve public understanding of .he 
process, foster consistency, and prevent oversights < id 
judgments that are inconsistent with current scientii c 
thought. The development and application of guidelii is 
would help to focus discussion by the public and the 
scientific community on the generic issues of risk 
assessment, outside the sometimes charged context of 
particular regulatory decisions. Such discussion coi .d 
stimulate research interest and lead to evolutionary 
improvement in the guidelines and thus in the quality of 
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risk assessment—improvement that would not occur if risk 
assessments were performed on an ad hoc basis. Guidelines 
also provide an efficient means to ensure the quality and 
relevance of data generated in new bioassay, epidemio¬ 
logic, and other pertinent studies on the toxicity of 
particular chemicals, thus improving the scientific data 
base for future risk assessments of those chemicals. 
Guidelines can also help regulated parties to know in 
advance the criteria that agencies will apply in evalu¬ 
ating substances. Industry would benefit if all federal 
agencies used the same guidelines. Furthermore, uniform 
federal guidelines could help to harmonize the current 
development of risk assessment methods by an increasing 
number of state programs. 

Uniform guidelines should be prepared for hazard 
identification, dose-response assessment, and risk char¬ 
acterization. Government-wide guidelines for exposure 
assessment may be impractical, and this aspect of risk 
assessment is treated separately in Recommendation 9. 

The Committee is aware of several arguments to the 
effect that uniform guidelines could have adverse effects. 
We believe, however, that well-designed and carefully 
applied guidelines will minimize these disadvantages. 


RECOMMENDATION 6 


The inference guidelines should be comprehensive, 
detailed, and flexible. They should make explicit the 
distinctions between the science and policy aspects of 
risk assessment. Specifically, they should have the 
following characteristics: 


• They should describe all components of hazard 
identification, dose-response assessment, and risk 
characterization and should require assessors to show 
that they have considered all the necessary components in 
each step. 

• They should provide detailed guidance on how each 
component should be considered, but permit flexibility to 
depart from the general case if an assessor demonstrates 
that an exception is warranted on scientific grounds. 

• They should provide specific guidance on 
components of data evaluation that require the imposition 
of risk assessment policy decisions and should clearly 
distinguish those decisions from scientific decisions. 
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They should provide specific guidance on how an 
assessor is to present the results of the assessment c d 
the attendant uncertainties. 


Distinguishing Science from Policy 

A frequent deficiency of agency risk assessments is tl: 
failure to distinguish between scientific and policy 
considerations in risk assessment. Critics contend tl t 
the results of risk assessment are often seen as scier 
tific f indings by regulators and the public, whereas : 
fact they are based in part on other considerations. he 
Committee believes that guidelines can lead to risk 
assessments that clearly delineate the limits of curre t 
scientific knowledge and the policy basis for choosinc 
among inference options. 


Comprehensive and Detailed Nature 

Comprehensive, detailed guidelines are needed to delii ate 
risk assessment as a process distinct from risk manage 
ment. Comprehensive guidelines are those which addres . 
all components of risk assessment that are subject to 
generic treatment. Detailed guidelines are those whi< i 
provide substantial supplementary scientific discussic 
of each component. Such discussion helps to reduce tl 
possibility that analysts will misuse guidelines as 
cookbook instructions and helps analysts to anticipate 
special conditions for which particular inference opt] ns 
are appropriate or inappropriate. 

Broad statements of principle are inadequate, becai e 
they leave components undefined and may permit excess. r e 
discretion in particular cases. An explicit, comprehe 
sive statement has the advantages of improving public 
understanding of government risk assessment and of 
assisting regulated parties to anticipate government 
actions. 

Another reason for specifying comprehensive, detai, \d 
guidelines is that they hold the greatest promise of 
preventing inconsistency within and among agencies, i • 
numerous points in a risk assessment, different risk 
assessors may select different (but scientifically va .d) 
inference options; guidelines should specifically add] ss 
each of these. A related advantage is an improvement .n 
quality control that could occur if all assessors wer< 
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required to consider the broad range of issues addressed 
in such guidelines? that would decrease the likelihood 
that important considerations would be neglected or that 
uninformed j udgment would occur. 


Flexibility 

The Committee espouses flexible guidelines. Rigid guide¬ 
lines, which permit no variation, might preclude the 
consideration of relevant scientific information peculiar 
to a particular chemical and thus force assessors to use 
inference options that are not appropriate in a given 
case. Also, rigid guidelines might mandate the continued 
use of concepts that become obsolete with new scientific 
developments. Large segments of the scientific community 
would undoubtedly object to such guidelines as incompat¬ 
ible with the use of the best scientific judgment for 
policy decisions. 

Flexibility can be introduced by the incorporation of 
default options. The assessor would be instructed to use 
a designated (default) option unless specific scientific 
evidence suggested otherwise. The guidelines would thus 
permit exceptions to the general case, as long as each 
exception could be justified scientifically. Such justi¬ 
fications would be reviewed by the scientific review 
panels and by the public under procedures described above. 
Guidelines could profitably highlight subjects undergoing 
relatively rapid scientific development (e.g., the use of 
metabolic data for inter species comparisons) and any other 
components in which exceptions to particular default 
options were likely to arise. They should also attempt 
to present criteria for evaluating whether an exception 
is justified. 


Presenting the Results of the Assessment 

Conclusions based on a large number of sequential, dis¬ 
cretionary choices necessarily entail a large, cumulative 
uncertainty. The degree of uncertainty may be masked to 
some extent when, in the final form of an assessment, 
risk is presented as a number with an associated measure 
of statistical significance. If they are to be most 
instructive to decision-makers, assessments should provide 
some insight into qualitative characteristics of the data 
and interpretations that may impute more or less certainty 
to the final results. 
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RECOMMENDATION 7 


The process for developing, adopting, applying, and 
revising the recommended inference guidelines for ris 
assessment should reflect their dual scientific and 
policy nature: 

• An expert board should be established to develc > 
recommended guidelines for consideration and adoptior by 
regulatory agencies. The board 1 s recommended guidelj ,es 
should define the scientific capabilities and limitat ,ons 
in assessing health risks, delineate subjects of unce - 
tainty, and define the consequences of alternative 
policies for addressing the uncertainties, 

• The expert board's report and recommendations 
should be submitted to the agencies responsible for 
regulating the hazards addressed by the guidelines fc ; 
their evaluation and adoption. The agencies, perhaps 
with central coordination, should, when possible, chc >se 
a preferred option from among the options that are 
consistent with current scientific understanding. Tl : 
procedures for adoption should afford an opportunity or 
members of the public to comment, 

• The process followed by the government for 
adoption of inference guidelines should ensure that t e 
resulting guidelines are uniform among all responsib] 
agencies and are consistently adhered to in assessing the 
risks of individual hazards* 

• The resulting uniform guidelines should govern 
the performance of risk assessments by all the agenci s 
that adopt them until they are re-examined and revise ?. 
they should not prevent members of the public from 
disputing their soundness or applicability in partici ar 
cases. In shorty the guidelines should have the stat s 
of established agency procedures, rather than bindinc 
regulations, 

• The guidelines should be reviewed periodically 
with the advice and recommendations of the expert boc 
The process for revising the guidelines, like the pre ess 
for adoption, should afford an opportunity for commer by 
all interested individuals and organizations. 

Inference guidelines for risk assessment are based 
largely on science, but other considerations are invo ved 
in components with substantial scientific uncertainty 
For these, the choice among inference options can hav 
substantial policy ramifications. Thus, we recommend a 
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two-step process in which a board of experts recommends 
guidelines and provides scientific commentary on avail¬ 
able inference options and then the government adopt s 
final guidelines based in part on the board B s 

recommendations. 


The Board and Its Role 

The recommended guidelines should be developed by a 
congressionally chartered board of experts who are 
independent of regulatory policy-making. We describe 

this board, its placement, and other functions that it 
can serve in Recommendation 10, In general terms, the 
board should be permanent, should represent professional 
excellence on a national scale, and should have facility 
with issues that have policy ramifications. We see 
advantages in locating the board outside the government. 

The board*s role is mainly scientific. It should 
define the components of risk assessment and describe the 
scientific basis for each. When it finds general scien¬ 
tific agreement on the proper inference option for a 
component, it should designate that option in a recom¬ 
mended guideline. When the board finds no general 
scientific agreement on the available inference options, 
it should recommend against the use of options that are 
scientifically unsupportable and comment on the relative 
strength of the scientific support for the options that 
remain.* 


Agency Adoption 

The Committee envisions that the second step in the 
establishment of guidelines will be in the hands of the 


*Some members of the Committee believe that the board 
should also be encouraged in such cases to recommend the 
option that it judges to have the most scientific support, 
as long as the board clearly indicates that such choices 
are based on members* informed scientific judgment, not 
on general agreement in the scientific community. Other 
Committee members believe that such recommendations would 
imply scientific certainty where none exists and thus 
would result in scientists* improperly recommending 
policy on the basis of their subjective judgments. 
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government. The choice of guidelines is, ultimately, lie 
responsibility of duly elected or appointed public 
officials, and public review and comment on the propos id 
guidelines should be completed before they are adopte< , 
The Committee emphasizes that, to be most useful, the 
final guidelines should prescribe default options for ill 
components of risk assessment• Thus, the second step 
should further limit the inference options available ■ > 
the agencies, even for components in which the board 
found that no single option could be chosen on scient :ic 
grounds. In that case, full consideration should be 
given to the board's comments on the merit of the sci< 1 - 
tific support that is available for each option. 

It is important that the process result in a timel; . 
uniform set of inference guidelines to be used by all 
agencies. We thus see advantage in coordination of tl i 
agencies' adoption of guidelines by a single, central 
authority such as the Office of Science and Technolog; 
Policy, or by a mechanism designated by Congress. 

The Committee believes that adopting the guideline as 
established procedures, rather than as formal regula¬ 
tions, would have several important advantages: it w< ild 
allow guidelines to be adopted and amended more easil: 
it would bind the agencies to adhere to the guideline: 
until they were reviewed and revised (thus fostering 
predictability and consistency—any agency's failure ■ > 
comply with its own guidelines could be noted by inde¬ 
pendent scientific review panels and could be cited a: 
grounds for interested parties' legal appeal of an 
associated regulatory decision); and it would permit 
members of the public to advocate new or alternative 
approaches to risk assessment. 

Joint risk assessments performed by interagency ta5 : 
forces should be governed by the guidelines that emer< i 
from this process. 

Uniformity 

The Committee has presented its case for uniformity ii 
guidelines: consistency in the conduct of risk assessr nt 
reduces the appearance of unfair and inconsistent regi .a- 
tory policies, improves priority-setting among regulal »rs* 
programs, increases public understanding, and provide: 
coherence for those subject to various regulatory autl >r- 
ities. A frequent argument against government-wide gi .de¬ 
lines is that different agencies have statutory respoi 
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sibilities that reflect different social policies and 
therefore require different approaches to risk assess¬ 
ment. This argument reflects a misunderstanding of the 
purpose of guidelines. An agency would remain free to 
incorporate whatever social judgments are embodied in its 
mandate when deciding whether and how to regulate. Such 
risk management choices can be made independently of and 
after the completion of a risk assessment. Thus, two 
agencies could use the same risk assessment of a sub¬ 
stance f but regulate it differently on the basis of 
statutory or policy criteria applied after risk 
assessment. 


Periodic Review 

The scientific basis of risk assessment is evolving 
rapidly. Guidelines must continue to evolve to accom¬ 
modate scientific innovations and theories. By their 
very nature, guidelines themselves will help to foster 
evolutionary improvements by defining generic principles 
of risk assessment and focusing debate and empirical 
research on these principles. 

Furthermore, new public perceptions of risk occur, and 
guidelines will evolve in response to these changes as 
well. For example, attitudes about the practicality of 
the outright elimination of carcinogenic risk as a regula¬ 
tory goal have changed in the last decade. New methods 
of quantitative risk assessment have developed, and public 
discussions have increasingly focused on that field. 

These changes can be expected to continue, so regular 
periodic review of guidelines appears to be essential. 

Such review should follow the same procedures recommended 
for the initial guidelines, including ultimate agency 
adoption after public comment. 


RECOMMENDATION 8 


The Committee recommends that guidelines initially be 
developed, adopted, and applied for assessment of cancer 
risks. Consideration of other types of health effects 
should follow. It may not yet be feasible to draw up as 
complete a set of inference guidelines for some other 
health effects. For these, defining the extent of scien¬ 
tific knowledge and uncertainties and suggesting methods 
for dealing with uncertainties would constitute a useful 
first step. 
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The Committee believes that guidelines for carcinog nic 
risk assessment should be drawn up first, both because 
cancer is perceived as a major public-health hazard ar 
because there is considerable experience with carcinoc nic 
risk assessment from which to draw. Several guideline 
documents for carcinogenic risk assessment have alreac 
been produced, and review of these documents and of th ir 
history should provide a useful point of departure. 

However, the other health effects that result from 
exposure to hazardous substances are equally amenable o 
prevention by regulatory action. Guidelines are desir ble 
for these types of effects, which include mutagenicity 
reproductive and teratogenic effects, neurotoxicity, a d 
behavioral changes. Less information (and, in some ci es, 
less knowledge of causal mechanisms) is usually availa le 
on these effects. In fact, in some situations where t e 
knowledge base is less adequate than in cancer, stipul ted 
methods for handling scientific uncertainty may be eve . 
more important. Risk assessments for cancer are likel 
more frequently to engage the problems of evaluating c .ta 
on exposure of experimental animals, whereas many othe 
health effects will require greater reliance on epiden o~ 
logic evidence. 

The Committee believes that the absence of guidelir s 
for a health effect is not a justification for agency 
failure to perform risk assessments or to regulate on 
case-by-case basis. 


RECOMMENDATION 9 

Agencies should develop guidelines for exposure assess 
ment. Because of diverse problems in estimating diffe ent 
means of exposure (e.g., through food, drinking water, 
and consumer products), separate guidelines may be nee ed 
for each. 

Operating assumptions are needed to estimate exposi es 
when direct measurements cannot be obtained. Examples of 
cases in which such estimates would be important are 1 ie 
projection of exposure to new chemicals and determinat on 
of the exposure reduction that would result from impl< len- 
tation of a particular control option. In only a few 
narrow cases (e.g., food additives) have general guid< 
lines been developed for exposure assessment. 

Although they are no less important than techniques 
for hazard identification and dose-response assessment 
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exposure assessment techniques have not been the subject 
of major scientific debate and scrutiny. For example, if 
exposure were known more accurately, priority-setting for 
testing new chemicals or for initiating regulation of one 

of a group of chemicals could be organized on a more 
rigorous basis? consideration of both the apparent potency 
and the estimated exposure would be factored into such 
decisions. 

Exposure assessment guidelines that are uniform across 
federal programs may not be feasible , because of the 
diversity of media that must be addressed and the large 
variation in exposures. Medium-specific exposure models 
(such as dispersion models for air, water, and soil) are 
used by programs in the agencies with various degrees of 
sophistication and validation. Each agency or each pro¬ 
gram in an agency should develop medium-specific guide¬ 
lines to stimulate evolutionary improvement, increase 
consistency and predictability, and isolate the choice 
among inference options from inappropriate risk manage¬ 
ment considerations. Two or more programs that deal with 
a given medium of exposure should use the same guidelines. 

Agencies should make their proposed exposure assess¬ 
ment guidelines available for public comment and should 
subsequently issue final guidelines as established 
procedures. 


A CENTRAL BOARD ON RISK ASSESSMENT METHODS 
RECOMMENDATION 10 

The Committee recommends to Congress that a Board on Risk 
Assessment Methods be established to perform the following 
functions : 

• To assess critically the evolving scientific basis 
of risk assessment and to make explicit the underlying 
assumptions and policy ramifications of the different 
inference options in each component of the risk assess¬ 
ment process. 

• To draft and periodically to revise recommended 
inference guidelines for risk assessment for adoption and 
use by federal regulatory agencies. 

• To study agency experience with risk assessment and 
evaluate the usefulness of the guidelines. 

• To identify research needs in the risk assessment 
field and in relevant underlying disciplines. 
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To avoid possible misunderstanding of the role of th 
Board, the Committee stresses the limitations on propos 
Board activities. The Board would not perform or revie 
individual risk assessments, nor would it adjudicate di 
putes arising from regulatory actions related to specif 
substances. Thus, the Board as envisioned would not pe 
form functions contemplated by the AIHC proposal or H.R 
638. A central board of distinguished expert advisors 
not well-suited to such day-to-day responsibilities. 
Furthermore, we believe strongly that it would be inapp 
priate to remove such essential analytic functions from 
the responsible agencies and that it would be wasteful 
duplicate agency activities. 

The Board would make its contributions through disci] 
sion of contending scientific positions, preparation of 
recommended uniform guidelines, and fostering of advanc 
ment of the field. It would fill a need for a prestigi 
ous, independent locus of activity for improving the 
understanding of generic issues in both the scientific 
basis and the federal practice of risk assessment. 
Current ad hoc approaches too often color debate on 
general issues with the implications for particular, 
often contentious, risk management decisions. We expec 
that Board activities would improve the scientific 
performance of the agency processes and, in conjunctior 
with other mechanisms we recommend, achieve greater 
objectivity and consistency and better public understan 
ing of risk assessment. The Board would be the body tc 
which agencies, agency review panels, and others would 
turn both for periodic recommendations of guideline 
revisions and for information on the evolving art of 
risk assessment. 


d 


s 

D- 
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Board Functions 

We foresee four major functions for the Board. The fir t 
two, scientific review and development of recommended 
guidelines, would pursue the process described above fc 
the initial generation of inference guidelines (Recomme - 
dation 7). The drafting of guidelines by the Board wou d 
ensure that guidelines benefit from the best available 
scientific knowledge and judgment. After recommended 
guidelines for a particular health effect were prepared 
and referred to the agencies for review and adoption, t e 
Board would probably find it useful to continue its act v- 
ity in the review of scientific developments relevant t 
risk assessment for that effect. 
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The Board's third function would involve observation 
of and research into federal experience with risk assess¬ 
ment generally and review of the usefulness of guidelines. 
A major purpose would be to acquaint the Board with ways 
of improving the guidelines in later periodic reviews. 

As a fourth function, the Board would identify the key 
scientific research needs in health risk assessment. 
Preparation of guidelines would put the Board in an ideal 
position to understand which of the many inference options 
needed to cover gaps in scientific understanding are most 
important and are amenable to study. The policy difficul¬ 
ties in regulating chronic health hazards can be resolved 
only if uncertainty in the scientific basis of assessments 
is reduced. Board activities could take such forms as 
advising funding agencies on research priorities, commis¬ 
sioning survey papers to synthesize recent scientific 
findings, and sponsoring conferences or special publica¬ 
tions on particularly apt scientific questions or on 
matters that are important to risk assessment, but have 
been neglected by the scientific community. In addition, 
the Board's experience would place it in an ideal posi¬ 
tion to assess whether and how toxicologic research on 
particular chemicals could be better tailored to the 
analytic needs of future risk assessors. For example, 
many current testing procedures were designed for the 
narrow purpose of hazard identification, and adjustments 
in these procedures could lead to more definitive dose- 
response assessments. 

The Committee believes that the responsibilities of 
the Board could be discharged by a group of volunteer 
experts that convened monthly for 1-2 days. 


Organizational Placement 

The proper placement of the Board would be crucial to its 
prospects for success. There are four criteria for 
identifying appropriate locations: professional 
excellence, facility with studies having substantial 
policy ramifications, permanence, and independence. 

Professional excellence is important because the 
Board's recommended guidelines, as well as its other 
work, should be based on the best available science? the 
Board should be able to attract the best talent in the 
nation. Facility with difficult policy issues is impor¬ 
tant because risk assessment is not a strictly scientific 
undertaking, and it would be crucial for the Board to 
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conduct its work competently and with full understands 
of the policy process. Placement in a permanent, exist ig 
organization is advisable because the Board should be 
able to begin its work quickly and remain stable in ord' : 
to conduct periodic revisions of guidelines. Independei :e 
is needed to provide credibility? work that is suspecte* 
of bias will not transcend the current atmosphere of di; - 
trust. We see advantages in placing the Board outside 
the government. In particular, the Board should be abl< 
to draw on the widest pool of scientific experts and no 
be restricted to government scientists? placement in th 
government might hinder the perception that the Board i 
free from the policy orientation of the administration n 
power? and direct involvement by the regulatory agencie 
themselves could detract from their ability to make reg - 
latory decisions while the guidelines were in preparati n. 

The Committee has evaluated a number of possible 
organizational bases for the Board. The National Toxi¬ 
cology Program has had relevant experience with the 
scientific basis of risk assessment, but it already has 
major responsibility for coordinating testing of chemi¬ 
cals of interest to regulatory agencies. The Congres¬ 
sional Office of Technology Assessment is another 
possibility. However, the governance of the Office of 
Technology Assessment by a board composed of members of 
Congress could prove a practical impediment to the 
production of guidelines. Guidelines would clearly hav 
policy ramifications that may be at variance with the 
established policy positions of OTA board members. The 
Office of Science and Technology Policy or the Office c 
Management and Budget could provide government-wide 
coordination? both are in the Executive Office of the 
President and are well positioned to ensure agency 
response and uniform implementation of guidelines and 
other Board findings. The major disadvantage of locati n 
in the Executive Office of the President is the lack ol 
independence and, consequently, the greater likelihood f 
mixing scientific and policy considerations. All these 
organizations share the major drawback that they are ir 
the government. 

A special-purpose national (or Presidential) commis¬ 
sion on risk assessment methods could attract eminent 
scientists to service and*could be designed to balance 
viewpoints, but would lack permanence and policy exper: • 
ence. Professional societies constitute another class >f 
possible candidates, but they generally have limited 
familiarity with policy studies. 
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We conclude that the National Academy of Sciences- 
National Research Council meets the four criteria for 

placement. The AIHC proposal addressed the same general 
concerns that have occupied this Committee and concluded 
that the most appropriate locus for the central panel was 
in the NAS-NRC. Although we do not concur in the idea of 
centralizing the performance of risk assessments, the 
arguments presented by the AIHC proposal for the selection 
of the NAS-NRC are fully applicable to the question of 
the placement of a Board that would address generic scien¬ 
tific issues in risk assessment. We believe that the 
Board could best function under NAS-NRC auspices, if the 
NAS-NRC agreed to provide them, and would be of great 
value in achieving many of the goals that we share with 
the authors of the AIHC proposal and of H.R. 638. Current 
NAS-NRC procedures for establishing, managing, and issuing 
study reports are appropriate for the prospective Board. 


Qualifications of Members 

We recommend that the Board consist of scientists with 
training and experience in the various disciplines 
involved in the process of risk assessment, including 
biostatistics, toxicology, epidemiology, environmental 
engineering, and clinical medicine. Other relevant 
fields—such as law, ethics, and the social sciences-- 
should be included to ensure due appreciation of the 
policy context of Board activities. For the same reason, 
some members should have familiarity with regulatory 
programs. The nomination and selection of members should 
be in accordance with established NAS-NRC procedures. 
Service might be for staggered 3-year periods. 


Sunset Review 


The entire concept of the Board and its functions should 
be reviewed after approximately 6-8 years. 
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REUEL A. STALLONES, Chairman/ is Dean of the University 
of Texas School of Public Health in Houston, Dr, 
Stallones is an epidemiologist specializing in studies 
of risk factors in cardiovascular disease and is a 
member of the Institute of Medicine. He is a past 
member of the NRC Board on Toxicology and Environ¬ 
mental Health Hazards and has served on several NRC 
committees that evaluated the risks of environmental 
pollutants. 

MORTON CORN is Director of the Division of Environmental 
Health Engineering at the School of Hygiene and Public 
Health/ The Johns Hopkins University. He specializes 
in evaluation and engineering control of airborne 
chemical agents in the workplace and the atmosphere. 

Dr. Corn served as the Assistant Secretary of Labor 
for Occupational Safety and Health from October 1975 
to January 1977. He is a member of the Panel of 
Experts in Occupational Health of the World Health 
Organization and serves on committees of EPA's -Science 
Advisory Board and the Congressional Office of 
Technology Assessment. 

KENNY S. CRUMP is President of Science Research Systems, 
Inc., a consulting firm specializing in the evaluation 
of statistical data and risk assessment. His work on 
methods of extrapolating from high to low doses is 
used by EPA's Carcinogen Assessment Group. He was 
previously with Louisiana Tech University where he was 
Professor of Mathematics and Statistics. 

J. CLARENCE DAVIES is Executive Vice President of the 
Conservation Foundation. He has served on other NRC 
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committees dealing with regulatory issues, was chair¬ 
man of the NRC Committee on Principles of Decision 
Making for Regulating Chemicals in the Environment 

(1974-1975), and now serves on the Environmental 
Studies Board. Dr. Davies served for 6 years as a 
member of the Executive Committee of EPA 1 s Science 
Advisory Board. 

VINCENT P. DOLE is Professor of Medicine at Rockefeller 
University and conducts research on addictive behavic 
and metabolic diseases. Dr. Dole is a member of the 
National Academy of Sciences and has served as an NAS 
reviewer of a number of risk-related studies. 

TED R. I. GREENWOOD is Associate Professor of Political 
Science at MIT. He has served as a Senior Policy 
Analyst in the Office of Science and Technology Polic 
(1977-1979). Dr. Greenwood has written about the 
problem of nuclear waste disposal and recently 
completed a monograph on the interaction between 
knowledge and discretion in regulatory decision-makir 

RICHARD A. MERRILL is Dean of the Law School of the 

University of Virginia. He has been on the Law Schoc 
faculty since 1969, except for 2 years (1975-1977), 
when he served as Chief Counsel to the FDA. He 
recently completed a study of regulatory decision¬ 
making on carcinogens for the Administrative Conferer 
of the United States that focused on FDA 1 s regulatior 
of food contaminants, CPSC 1 s regulation of chronic 
hazards, OSHA* s program for workplace carcinogens, ar 
the EPA pesticides program. Dean Merrill is a member 
of the Institute of Medicine and the NRC Board on 
Toxicology and Environmental Health Hazards. He 
teaches food and drug law, environmental health 
regulation, and administrative law. 

FRANKLIN E. MIRER is Director of the Health and Safety 

Department of the International Union, United Auto 
Workers. Dr. Mirer, an industrial hygienist and 
toxicologist, has been with the UAW since 1975. He 
specializes in issues related to workplace chemical 
exposures and development of OSHA standards. 

D. WARNER NORTH is a Principal with Decision Focus, Inc. 
a consulting firm specializing in decision analysis, 
and consulting Associate Professor with the Departmer 
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of Engineering-Economic Systems at Stanford University, 
Over the last 15 years. Dr. North has carried out 
applications of decision analysis and risk assessment 
to a variety of public-policy issues. He has par tic i- 
pated in three previous NRC studies on air quality and 
toxic chemicals. His recent projects include work on 
methods for setting priorities and developing a 
regulatory strategy for toxic chemicals for the EPA 
Office of Toxic Substances. Dr. North has served on 
committees of the EPA Science Advisory Board since 
1977. 

GILBERT S. OMENN is Dean of the School of Public Health 
of the University of Washington in Seattle. A 
physician and geneticist. Dr. Omenn served in senior 
positions in the Office of Science and Technology 
Policy and in the Office of Management and Budget 
(1977-1981) • He is a member of the Institute of 
Medicine. At OSTP, he was concerned with federal 
decision-making for public-health risks and was 
coauthor of a paper on the process for making such 
decisions. Before returning to the University of 
Washington, Dr. Omenn was a Fellow at the Brookings 
Institution, where he analyzed EPA 1 s 1979 decision to 
revise the national ambient air quality standard for 
photochemical oxidants (measured as ozone)• 

JOSEPH V. RODRICKS is a Principal with ENVIRON 

Corporation, a Washington, D.C., consulting firm 
specializing in risks related to exposure to toxic 
substances. Dr. Rodricks, a biochemist, was with the 
FDA for 15 years (1965-1980) • While at FDA, he served 
as Deputy Associate Commissioner and as chairman of an 
interagency work group on risk assessment that devel¬ 
oped guidelines for member agencies to follow for 
determining risks associated with exposure to carcino¬ 
genic chemicals. Dr. Rodricks is a member of the NRC 
Board on Toxicology and Environmental Health Hazards 
and a Diplomate of the American Board of Toxicology. 

PAUL SLOVIC is a psychologist at Decision Research in 

Eugene, Oregon. His research interests are related to 
human judgment in decision-making, with special 
emphasis on perception of risk, and he is coauthor of 
a book on the concept of acceptable risk. Dr. Slovic 
has served as a consultant to FDA, NSF, the National 
Institute of Mental Health, and the Nuclear Regulatory 
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Commission, He has been a council member of the 
Society for Risk Analysis and is President-elect of 
that organization. 

H. MICHAEL D. UTIDJIAN is Corporate Medical Director at 
the American Cyanamid Company. Dr. Utidjian has beer 
active in occupational medicine since 1961. Before 
gaining his current position, he was a Staff Scientis 
at Stanford Research Institute and served as a 
consultant to NIOSH. He also served as Associate 
Corporate Medical Director at Union Carbide. 

ELIZABETH WEISBURGER is Assistant Director for Chemical 
Carcinogenesis at the National Cancer Institute. Dr. 
Weisburger, a toxicologist/oncologist, has been at NC 
for 33 years and was involved in initial NCI decisior 
on establishing its bioassay program and determining 
which compounds to test. 



APPENDIX B 
Bibliography 


1. GUIDELINES AND POLICY FOR RISK ASSESSMENT 

Albert, R. E., R. Train, and E. Anderson. Rationale 
Developed by EPA for the Assessment of Carcinogenic 
Risks. Journal of the NCI Vol. 58, No. 5, May 1977, 
pp. 1537-1541. 

Calkins, D. R., R. L. Dixon, C. R. Gerber, D. Zarin, and 
G. S. Omenn. Identification. Characterization and 
Control of Potential Human Carcinogens: A Framework 
for Federal Decision-Making. Journal of the NCI Vol. 
64, No. 1, January 1980, pp. 169-176. 

Consumer Product Safety Commission. Interim Policy and 
Procedure for Classifying, Evaluating, and Regulating 
Carcinogens in Consumer Products. Federal Register 
Vol. 43, No. 114, June 13, 1978, pp. 25658-25665. 

Department of Labor, Occupational Safety and Health 
Administration. Identification. Classification, and 
Regulation of Potential Occupational Carcinogens. 
Federal Register Book 2 of 2, Vol. 45, No. 15, January 
22, 1980, pp. 5001-5296. 

Environmental Protection Agency. Health Risk and 

Economic Impact Assessments of Suspected Carcinogens: 
Interim Procedures and Guidelines. Federal Register 
Vol. 41, No. 102, May 25, 1976, pp. 21402-21405. 

Environmental Protection Agency. Mutagenicity Risk 
Assessments; Proposed Guidelines. Federal Register 
Vol. 45, No. 221, November 13, 1980, pp. 74984-74988. 

rood and Drug Administration. Chemical Compounds in Food 
Producing Animals: Criteria and Procedures for 
Evaluating Assays for Carcinogenic Residues. Federal 
Register Vol. 44, No. 55, May 20, 1979, pp. 
17070-17114. 







Bo ,P B, 



Aid £ C, a , '* 

. a\.ii { ; , f 1 L ‘i 

. F e cl e r a 1 S c c a t ecj 

t Qf As S\ 5 L 

awMt ar.u Asp n t s » 

1 , l . ss i < , u \ k 

to the o i 

L 1 CV .~’f i‘ ;Arvs » J j 

I'i s, , 

American Tnd 

.rat. i l i do d as L u ij . _ , 

^ : a ! 

Sclsnc'd ) 

ana i ; - 1 ' Liiiooj i ‘Cl i , “ 

1981, 9 pp. and 

Append i r s 

Add 1'OC rsiit' a fid r‘ 1 C'C A i /» 

'ork for Identify 

Card nos a 

r , ) Kt- is ' ; p 1 ho-ii i 

C < r ( 

Sifuatior 

is „ 's'one: Id 197% d 

' C S 















2 v a '/ « ifi 1 > 1 ' f f 

": Ui_ o, 1 ~jt e, 3 

no / a. 

Ramo, S. Regulation of Technical 

' u! i o i * > v- ' _ ' 

837-342a 

!• i > i ,_t ! c 

_«3 » n _u* R c * , ^ l 1 

nt [ ! u i oi <1 < . i * O fi 

S . i it\ RLR , , f . b . 

L . 1 ’ '‘(A V t . I f ) 

v\oi o , I j‘ I [ . i 

Rt vfLi 1 I y / 1 1 r a . l , \ 

8 /V—otJU* 

Cox lc tub 0 :lc» o i < - > 1 ^ f) 

n r^r u ie i 1 n ^ - gg^ ge m ' ,_ ___ t 

0 ij , Gov e> o > r * t ^ r * u o 15 > <. 

1980 . 



0 .S. House of Representatives« Oml< it_nfg_RuTgec 
Reconclxia t _i igg. r _ l j - > J ^ on fe re nee Report 

Report 97 - 208 , Julv “iOR ~~f 7 ‘ R t 183 









f e L . 


i v £ 10 , 00 ™ n c it; i t \ jo 

Me do . 


' C5 n „ 

Hoel, " 


„ - cm ; ~ m .j. 

f.c.Ift 


( . LI; i „ j a l ; on a - 

A Is! <=- 


*or o jd.LVzHr c: 

Tc o i, 


Jo ■' V — i C : 5 30 _ 

133-15 ii 



Howard , R 

, A , 

C i'.xl 1 ito: t ioi 

Aria Ly a 

-s fo 

r n IL r b ^ , 

Jane 1 



Karch, c 


i . ni?r l;or 

Id - .1 c - 

uX/LlLi 

' . t.- o: (V'i iC'W'sy and 

A PA. 

/ O iCLHIi 

> ’ . l < m: w jcL- r:s • oC 

Sc lei r 

i £ 3 1 


Lave, L , 

and 

- s / e* £ o LcCy ^-rvelt on 

Fed era 


1 i * uicrv Couiiiiir vion 

kefn - v 

1REG/ 

! 5 1 . 4 £ . ,r „ 

Leape, d 


, . c > - a A rsec Lamenr In Regulation 

of 17 .' t 

i. ronrn 

i 7a Mu 1 Li. i. r mrsental 

I C* 1/ ' 

view 

on i\ - < ‘ o 

Levant 1 1 ^1 

H , 

i« " i n mat inn an rhe Rote 

(H T [>c 

Co u £ 

• i, n i 1 £ . jiin.3 a on a Lav/ Re v « ew 

‘JO *L i , 

1 i 1 on i n “ 5£ > 

LOW fc ill’ * , 

C 1 

i ., < \ A A 1 « S’ it nee dnd_ EMoi 

])e U i l* 

in at i 

i - , C 0 > 1 j , 4i)l r < .jtiCTi ' to I.os 

A L to la 

C a 13 

T““7'l97 6^' 180 ppo 

Man Lo l , C 

« j ei 

o i 1 ’ \i « \ )} t r o j '* ScilVA 

‘.c,h- ! 


' ■ 'O t. H { aioe/_ jonso^ ged Vol 

,n 3 j 

a ’ 1 

' u 1 1 u o 

MClinl i 1 v j 


, in i v ( 1 f i i ‘ Ok. 1 U t L Li LX f el' i o . 

i P *. 

i nisi 

\ , u 1 J no if tir - 1 i^y 

11H O’ ' 


, ! i <' . i L / aP i OSK'A , 

n « M J 

1 w 

. »1 t ' . • , IS / Lfn /ACi-li 5 

Me i « i 1 

a, a. 

1 *0 IL 30 r a ! 01L LJ 

■ t al ( ' a * 


i , ,io t ,i. . Of L' i ow Vo[ LR ‘ l< 81 


i 


A i-ri 1 j i (l 


l.i ( . ^ Luaeist.ii CoJitarn ' an - 

!' 1 l ' r i w 

£ ‘O, 

i -0 j t 1 > i it v j e Voj a (Co,. 1 9L0, j"o 

.1,3 57,, 



Merr Ll.i t 

Co, a. 

u* n lor of Cancer-Cansing 

id hemic*, 

a i s, 

,ii , h f w t to Ce Administrative 

Con re r: 

enen 

M 1 1 1 ,M>” d Cf‘X., April i, 1982, 

Kuriico 3 « 

C „ , 

, i , »m v< K i Risk Assessment and 

Reg u la i o v > 

Leo l a .An ran k inq. food and Cosme f ic 

Tox1c 3 

120:0 

V j[ CR ! jb 1 , pro 549-56 0. 
















o t 

K s 
u*'« 



!!■: «M. FORMALDEHYDE 


SSMttNTK LL * jSIlA/OIOSH 




•s , >1 hM4EN i 

. J( '*i ; « !' iold 


a i 





